00000001:02000400:3.0F:1789498196.589882:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789498215.410353:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789498217.747228:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 618 MB/s 00000001:01000000:2.0:1789498217.997364:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 883 MB/s 00000001:01000000:2.0:1789498218.247172:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4979 MB/s 00000020:02000000:0.0:1789498219.012986:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g104cf8c 00000400:02000000:3.0:1789498220.542338:0:3288:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.120@tcp [8/256/0/180] 00008000:02000000:3.0:1789498224.629167:0:3438:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1789498284.978867:0:5240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789498296.071068:0:5826:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789498296.071075:0:5826:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789498296.071362:0:5826:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009b5dc2ca 00000080:02000400:2.0:1789498296.071375:0:5826:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789498296.076366:0:5826:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789498296.076381:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789498296.076423:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f53cd3e3) 00000020:00000080:2.0:1789498296.076446:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789498296.107031:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789498296.107540:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789498296.145956:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789498296.145998:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789498296.146248:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789498296.146305:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789498296.146334:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789498296.147219:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789498296.147228:0:5826:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789498296.147239:0:5826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc17e8c 00000020:01000004:2.0:1789498296.147248:0:5826:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789498296.147252:0:5826:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789498296.147257:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b5dc2ca from MGS 00000020:01000004:2.0:1789498296.147261:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789498296.147271:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a6f463db) 00000020:00000080:2.0:1789498296.147280:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789498296.147340:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b5dc2ca from MGS, refs=2 00080000:01000000:2.0:1789498296.147346:0:5826:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789498296.147351:0:5826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc17e9a 00000100:00100000:2.0:1789498296.147884:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789498296.148017:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789498296.148024:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789498296.149267:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789498296.149278:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789498296.149968:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498296.151311:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789498296.151320:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789498296.161777:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789498296.161802:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789498296.171054:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789498296.171070:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789498296.172010:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498296.172014:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498296.172016:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498296.172455:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498296.172457:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498296.172459:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498296.173134:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789498296.176583:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789498296.423085:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2491 MB/s 00000001:01000000:2.0:1789498296.673983:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2883 MB/s 00000001:01000000:2.0:1789498296.923639:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 443 MB/s 00000001:01000000:3.0:1789498297.181841:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 647 MB/s 00010000:00010000:0.0:1789498297.197464:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789498297.204058:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789498297.258610:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789498297.258630:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789498297.258632:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789498297.265686:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789498297.265792:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789498297.265940:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789498297.266698:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789498297.266762:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789498297.267417:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498297.267587:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789498297.267593:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789498297.276729:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789498297.276744:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789498297.277081:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789498297.277109:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789498297.284034:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789498297.284059:0:5826:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.120@tcp' 00000020:01000004:3.0:1789498297.284061:0:5826:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789498297.284132:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.120@tcp (typ=mgc) 00000020:00000080:3.0:1789498297.284152:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.120@tcp (00000000f30361ef) 00000020:00000080:3.0:1789498297.284170:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789498297.284291:0:5826:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000012938e8c@MGC192.168.201.120@tcp: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1789498297.284540:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.120@tcp-0 is initialized 00000040:01000000:3.0:1789498297.284546:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789498297.284895:0:5841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789498297.286529:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789498297.286612:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.120@tcp (uuid ec95aa81-4721-4a06-ac30-039c6a8f6732) 00000020:00000080:1.0:1789498297.286639:0:5826:0:(genops.c:1384:class_connect()) connect: client ec95aa81-4721-4a06-ac30-039c6a8f6732, cookie 0x3a6cb1946bc17ea8 00000100:00080000:1.0:1789498297.286651:0:5826:0:(import.c:545:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789498297.286662:0:5826:0:(import.c:666:import_select_connection()) MGC192.168.201.120@tcp: import 0000000012938e8c using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1789498297.290882:0:5826:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008c586cf8 x1876424885534848/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498297.290926:0:5826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS 00000020:01000004:1.0:1789498297.290963:0:5826:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789498297.290973:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789498297.291002:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000094559a0e) 00000100:00100000:2.0:1789498297.291135:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c586cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec95aa81-4721-4a06-ac30-039c6a8f6732:3304:1876424885534848:0@lo:250: 00000020:00000080:1.0:1789498297.291171:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789498297.291238:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498297.291336:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885534848 00000100:00100000:2.0:1789498297.291344:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885534848 00000100:00100000:2.0:1789498297.291371:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498297.291377:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005642d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1876424885534848:12345-0@lo:250: 00010000:00080000:2.0:1789498297.291400:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ec95aa81-4721-4a06-ac30-039c6a8f6732@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1789498297.291428:0:5837:0:(genops.c:1384:class_connect()) connect: client ec95aa81-4721-4a06-ac30-039c6a8f6732, cookie 0x3a6cb1946bc17eb6 00000100:00080000:2.0:1789498297.291612:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000fef6055d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498297.291668:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005642d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:3304:x1876424885534848:12345-0@lo:250: Request processed in 290us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498297.291677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498297.291739:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789498297.291748:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1789498297.291756:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789498297.291760:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789498297.291763:0:3304:0:(import.c:65:import_set_state_nolock()) 0000000012938e8c MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789498297.291766:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789498297.291774:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789498297.291779:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c586cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec95aa81-4721-4a06-ac30-039c6a8f6732:3304:1876424885534848:0@lo:250: 00000100:00100000:1.0:1789498297.315442:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498297.315699:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789498297.315706:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789498297.327637:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789498297.327656:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789498297.330624:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789498297.330637:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789498297.334327:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498297.334652:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789498297.334659:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789498297.340246:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789498297.340273:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789498297.422933:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498297.423201:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789498297.423215:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789498297.431025:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789498297.431040:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789498297.431812:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498297.432015:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789498297.432020:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789498297.432852:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789498297.432972:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789498297.433681:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498297.434373:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789498297.434381:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789498297.435134:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789498297.435144:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789498297.437547:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498297.437752:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789498297.437758:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789498297.439168:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789498297.439181:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789498297.533648:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498297.533882:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789498297.533889:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789498297.544502:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789498297.544520:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789498297.545819:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789498297.545832:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789498297.548365:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789498297.548400:0:5826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789498297.548407:0:5826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789498297.548576:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789498297.548615:0:5826:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789498297.548620:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789498297.548621:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789498297.548622:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498297.548624:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498297.548625:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498297.548626:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498297.548628:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498297.548629:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789498297.548630:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789498297.548632:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789498297.548633:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498297.548634:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498297.548636:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789498297.548638:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789498297.548639:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789498297.548641:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498297.548642:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498297.548643:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498297.548644:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498297.548645:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498297.548646:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789498297.548647:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789498297.548648:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789498297.548649:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498297.548650:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498297.548677:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789498297.548695:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885534976:0@lo:253: 00000100:00100000:1.0:1789498297.548794:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498297.548856:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000145b6857 going to sleep for 11 seconds 00000100:00100000:3.0:1789498297.549115:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885534976 00000100:00100000:3.0:1789498297.549125:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885534976 00000100:00100000:3.0:1789498297.549189:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498297.549198:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de284e64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:5826:x1876424885534976:12345-0@lo:253: 20000000:01000000:3.0:1789498297.549252:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789498297.549255:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789498297.554414:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789498297.554552:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789498297.554930:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789498297.556219:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789498297.556524:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789498297.556529:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789498297.556535:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789498297.556538:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789498297.556554:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789498297.556810:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498297.557062:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789498297.557077:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789498297.557394:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789498297.557464:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789498297.557517:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789498297.557619:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789498297.557629:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789498297.557677:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789498297.557685:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789498297.557740:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789498297.557748:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789498297.557780:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789498297.557832:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789498297.557877:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789498297.557883:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789498297.557899:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498297.558165:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789498297.558176:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789498297.558213:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789498297.558247:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789498297.558292:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789498297.558303:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789498297.558378:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789498297.558387:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789498297.558433:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789498297.558474:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789498297.558529:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789498297.558541:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789498297.558624:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789498297.558633:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789498297.558667:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789498297.558703:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789498297.558869:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789498297.558918:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789498297.558927:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789498297.568361:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789498297.568926:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789498297.568956:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.120@tcp for mdt 20000000:01000000:3.0:1789498297.568958:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.120@tcp (null) (null) (null) 00000040:00080000:3.0:1789498297.568996:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789498297.569003:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789498297.569035:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789498297.569057:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.120@tcp (null) (null) 00000040:00080000:3.0:1789498297.569141:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789498297.569151:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789498297.569185:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789498297.569220:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789498297.569281:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789498297.569285:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789498297.569289:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789498297.569300:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789498297.569302:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789498297.569328:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789498297.569331:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789498297.578364:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789498297.578802:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789498297.578858:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789498297.578896:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789498297.578911:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789498297.578913:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789498297.580395:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789498297.580855:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789498297.580903:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789498297.580984:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789498297.581001:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789498297.581004:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789498297.581008:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789498297.581011:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789498297.581015:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789498297.581022:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789498297.582238:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789498297.586486:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789498297.597522:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1789498297.597582:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1789498297.597700:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1789498297.597741:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789498297.597766:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597797:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597808:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597815:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597821:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597828:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597834:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a7163091 already unused, calling callback (000000007e49e848) 00010000:00010000:3.0:1789498297.597837:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597845:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597859:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597865:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498297.597871:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17ebd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789498297.597899:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789498297.884071:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de284e64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:5826:x1876424885534976:12345-0@lo:253: Request processed in 334866us (335269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498297.884086:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498297.884318:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885534976:0@lo:253: 10000000:01000000:1.0:1789498297.884331:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789498297.884333:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789498297.884335:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789498297.884336:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498297.884336:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789498297.884337:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498297.884338:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498297.884339:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498297.884340:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789498297.884341:0:5826:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789498297.884342:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498297.884343:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789498297.884363:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b5dc2ca from lustre-MDT0000 10000000:01000000:1.0:1789498297.884388:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789498297.884390:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789498297.884393:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98ea83f28000 10000000:01000000:1.0:1789498297.884398:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789498297.884405:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98ea83f28000 from 1 10000000:01000000:1.0:1789498297.884407:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789498297.884447:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: 000000006e200d78/0x3a6cb1946bc17ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.884456:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: 000000006e200d78/0x3a6cb1946bc17ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.884464:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: 000000006e200d78/0x3a6cb1946bc17ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498297.884481:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535104:0@lo:101: 00000100:00100000:1.0:1789498297.884645:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498297.884737:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000066001009 going to sleep for 11 seconds 00000100:00100000:0.0:1789498297.884855:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885535104 00000100:00100000:0.0:1789498297.884862:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885535104 00000100:00100000:0.0:1789498297.884999:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498297.885006:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000960de305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:5826:x1876424885535104:12345-0@lo:101: 00010000:00010000:0.0:1789498297.885018:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498297.885032:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f33a2cee/0x3a6cb1946bc17ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17ec4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498297.885051:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f33a2cee/0x3a6cb1946bc17ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498297.885065:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f33a2cee/0x3a6cb1946bc17ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498297.885072:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f33a2cee, rc 0) 00000100:00100000:0.0:1789498297.885143:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000960de305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+6:5826:x1876424885535104:12345-0@lo:101: Request processed in 138us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498297.885147:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498297.885211:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535104:0@lo:101: 00010000:00010000:1.0:1789498297.885228:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: 000000006e200d78/0x3a6cb1946bc17ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.885234:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: 000000006e200d78/0x3a6cb1946bc17ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498297.885273:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535232:0@lo:501: 00000100:00100000:1.0:1789498297.885292:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498297.885747:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000066001009 going to sleep for 11 seconds 00000100:00100000:2.0:1789498297.885822:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885535232 00000100:00100000:2.0:1789498297.885826:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885535232 00000100:00100000:2.0:1789498297.885847:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498297.885850:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000023af7b72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+6:5826:x1876424885535232:12345-0@lo:501: 00000100:00100000:2.0:1789498297.886112:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000023af7b72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+6:5826:x1876424885535232:12345-0@lo:501: Request processed in 260us (819us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789498297.886117:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498297.886284:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535232:0@lo:501: 10000000:01000000:1.0:1789498297.886315:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789498297.886332:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: 000000006e200d78/0x3a6cb1946bc17ec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.886338:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: 000000006e200d78/0x3a6cb1946bc17ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498297.886347:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98ea90a2f000 10000000:01000000:1.0:1789498297.886351:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789498297.886354:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98ea90a2f000 10000000:01000000:1.0:1789498297.886356:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789498297.886359:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98ea90a2f000 from 1 10000000:01000000:1.0:1789498297.886361:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789498297.886380:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: 0000000099fd9521/0x3a6cb1946bc17ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.886385:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: 0000000099fd9521/0x3a6cb1946bc17ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.886401:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: 0000000099fd9521/0x3a6cb1946bc17ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498297.886412:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535360:0@lo:101: 00000100:00100000:1.0:1789498297.886437:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498297.886453:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000066001009 going to sleep for 11 seconds 00000100:00100000:2.0:1789498297.886516:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885535360 00000100:00100000:2.0:1789498297.886521:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885535360 00000100:00100000:2.0:1789498297.886538:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498297.886543:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000050ad121f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+6:5826:x1876424885535360:12345-0@lo:101: 00010000:00010000:2.0:1789498297.886657:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498297.886671:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003eb81210/0x3a6cb1946bc17ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17ed2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498297.886687:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003eb81210/0x3a6cb1946bc17ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ed2 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498297.886696:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003eb81210/0x3a6cb1946bc17ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ed2 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498297.886705:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003eb81210, rc 0) 00000100:00100000:2.0:1789498297.886751:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000050ad121f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+7:5826:x1876424885535360:12345-0@lo:101: Request processed in 208us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498297.886758:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498297.886822:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535360:0@lo:101: 00010000:00010000:1.0:1789498297.886831:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: 0000000099fd9521/0x3a6cb1946bc17ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.886836:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: 0000000099fd9521/0x3a6cb1946bc17ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498297.886845:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789498297.886855:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: 0000000099fd9521/0x3a6cb1946bc17ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.886859:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: 0000000099fd9521/0x3a6cb1946bc17ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498297.886863:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789498297.886866:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789498297.886869:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98ea90a2f000 10000000:01000000:1.0:1789498297.886870:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789498297.886872:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789498297.886874:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789498297.886885:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: 0000000079010e1d/0x3a6cb1946bc17ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.886894:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: 0000000079010e1d/0x3a6cb1946bc17ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.886901:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: 0000000079010e1d/0x3a6cb1946bc17ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498297.886912:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535488:0@lo:101: 00000100:00100000:1.0:1789498297.886949:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498297.886961:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000066001009 going to sleep for 11 seconds 00000100:00100000:2.0:1789498297.887008:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885535488 00000100:00100000:2.0:1789498297.887011:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885535488 00000100:00100000:2.0:1789498297.887024:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498297.887027:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e6e9fca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+7:5826:x1876424885535488:12345-0@lo:101: 00010000:00010000:2.0:1789498297.887032:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498297.887037:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c7aa434/0x3a6cb1946bc17ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17ee0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498297.887046:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c7aa434/0x3a6cb1946bc17ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498297.887051:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c7aa434/0x3a6cb1946bc17ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498297.887054:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c7aa434, rc 0) 00000100:00100000:2.0:1789498297.887081:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e6e9fca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+8:5826:x1876424885535488:12345-0@lo:101: Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498297.887084:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789498297.887152:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535488:0@lo:101: 00010000:00010000:1.0:1789498297.887160:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: 0000000079010e1d/0x3a6cb1946bc17ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498297.887164:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: 0000000079010e1d/0x3a6cb1946bc17ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498297.887192:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535616:0@lo:501: 00000100:00100000:1.0:1789498297.887218:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498297.887236:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000066001009 going to sleep for 11 seconds 00000100:00100000:2.0:1789498297.887339:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885535616 00000100:00100000:2.0:1789498297.887343:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885535616 00000100:00100000:2.0:1789498297.887360:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498297.887365:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a282c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+8:5826:x1876424885535616:12345-0@lo:501: 00000100:00100000:2.0:1789498297.887713:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a282c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:5826:x1876424885535616:12345-0@lo:501: Request processed in 340us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498297.887721:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498297.887858:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535616:0@lo:501: 00000100:00100000:1.0:1789498297.887887:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535744:0@lo:503: 00000100:00100000:1.0:1789498297.887933:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498297.887953:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000066001009 going to sleep for 11 seconds 00000100:00100000:2.0:1789498297.887996:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885535744 00000100:00100000:2.0:1789498297.888000:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885535744 00000100:00100000:2.0:1789498297.888013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498297.888017:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee9d9b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:5826:x1876424885535744:12345-0@lo:503: 00000100:00100000:2.0:1789498297.888163:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee9d9b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:5826:x1876424885535744:12345-0@lo:503: Request processed in 146us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498297.888168:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789498297.888306:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885535744:0@lo:503: 00000100:00100000:3.0:1789498297.889010:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007dd0e159 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:5868:1876424885535872:0@lo:502: 00000100:00100000:3.0:1789498297.889054:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498297.889126:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bf601c5 going to sleep for 11 seconds 00000100:00100000:2.0:1789498297.889190:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885535872 00000100:00100000:2.0:1789498297.889194:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885535872 00000100:00100000:3.0:1789498297.889348:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498297.889355:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087a30e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:5868:x1876424885535872:12345-0@lo:502: 00000100:00100000:3.0:1789498297.889656:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087a30e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:5868:x1876424885535872:12345-0@lo:502: Request processed in 302us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498297.889662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789498297.889855:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007dd0e159 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:5868:1876424885535872:0@lo:502: 00000020:01000000:2.0:1789498297.889876:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498297.889886:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498297.889887:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789498297.889894:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789498297.889897:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498297.889912:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000004582a5c) 00000020:00000080:2.0:1789498297.890029:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789498297.890042:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789498297.890144:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789498297.890151:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc17ef5 00000020:00000080:2.0:1789498297.890433:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789498297.890437:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498297.890439:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498297.890440:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789498297.890442:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498297.890444:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498297.890445:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789498297.890447:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498297.890452:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e10538a7) 00000020:00000080:2.0:1789498297.890459:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789498297.890461:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789498297.890462:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789498297.890465:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789498297.890468:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789498297.890631:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b5dc2ca from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789498297.890648:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000092831e13) 00000020:00000080:2.0:1789498297.890654:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789498297.890693:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789498297.890697:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc17f0a 00000020:00000080:2.0:1789498297.890790:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789498297.890796:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789498297.890799:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3a6cb1946bc17f11 00080000:01000000:2.0:1789498297.890803:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789498297.890806:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc17f18 00080000:10000000:2.0:1789498297.891405:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789498297.891678:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789498297.896698:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789498297.971867:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789498297.972420:0:5868:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789498297.975405:0:5868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789498297.975751:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789498298.009232:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009745dd41) 00000020:00000080:2.0:1789498298.009263:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789498298.009378:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789498298.009387:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc17f26 00000020:00000080:2.0:1789498298.010057:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789498298.011556:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498298.065968:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498298.103446:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498298.136124:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498298.175426:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1789498298.220552:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789498298.222552:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789498298.264240:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3a6cb1946bc17f2d 00000020:00000080:3.0:1789498298.265063:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789498298.265075:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498298.265081:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498298.265084:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789498298.265087:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498298.265124:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498298.265126:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789498298.265129:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789498298.265131:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789498298.265134:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498298.265136:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498298.265137:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789498298.265139:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498298.265144:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498298.265145:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789498298.265149:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789498298.265206:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789498298.265290:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001786b3ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:5868:1876424885536000:0@lo:502: 00000100:00100000:3.0:1789498298.265382:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498298.265441:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032b6f314 going to sleep for 11 seconds 00000100:00100000:1.0:1789498298.265883:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885536000 00000100:00100000:1.0:1789498298.265902:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885536000 00000100:00100000:1.0:1789498298.265954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789498298.265962:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022908d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:5868:x1876424885536000:12345-0@lo:502: 00000100:00100000:1.0:1789498298.266364:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022908d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:5868:x1876424885536000:12345-0@lo:502: Request processed in 401us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498298.266372:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498298.267879:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001786b3ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:5868:1876424885536000:0@lo:502: 00000020:01000000:3.0:1789498298.267936:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498298.267948:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498298.267950:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789498298.267955:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789498298.269082:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789498298.269163:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789498298.269182:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: 0000000079010e1d/0x3a6cb1946bc17ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.269313:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: 0000000079010e1d/0x3a6cb1946bc17ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498298.269322:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98ea90a2f000 from 1 10000000:01000000:1.0:1789498298.269325:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789498298.269363:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.269371:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.269381:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498298.269402:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536128:0@lo:101: 00000100:00100000:1.0:1789498298.269465:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498298.270350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885536128 00000100:00100000:3.0:1789498298.270361:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885536128 00000100:00100000:3.0:1789498298.270417:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498298.270424:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003df84d87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:5826:x1876424885536128:12345-0@lo:101: 00010000:00010000:3.0:1789498298.270437:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498298.270450:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17f34 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.270474:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.270483:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.270490:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7163091, rc 0) 00000100:00100000:3.0:1789498298.270534:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003df84d87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:5826:x1876424885536128:12345-0@lo:101: Request processed in 111us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498298.270541:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498298.281882:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 000000009178dcc1 going to sleep for 11 seconds 00000100:00100000:0.0:1789498298.281958:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80756b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536128:0@lo:101: 00010000:00010000:0.0:1789498298.281985:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.281998:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498298.282863:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000043a6ce74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536256:0@lo:256: 00000100:00100000:2.0:1789498298.286479:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498298.286594:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa41f58a going to sleep for 11 seconds 00000100:00100000:2.0:1789498298.295027:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885536256 00000100:00100000:2.0:1789498298.295048:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885536256 00000100:00100000:2.0:1789498298.295342:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789498298.295371:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cbc24a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:5826:x1876424885536256:12345-0@lo:256: 20000000:01000000:2.0:1789498298.295403:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789498298.295409:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789498298.295554:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cbc24a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:5826:x1876424885536256:12345-0@lo:256: Request processed in 186us (9084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498298.295562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498298.295663:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000043a6ce74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536256:0@lo:256: 10000000:01000000:1.0:1789498298.296393:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789498298.296427:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.296441:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498298.296450:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea90a2f000 from 1 10000000:01000000:1.0:1789498298.296454:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789498298.296496:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.296503:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.296513:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498298.296533:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f612ca04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536384:0@lo:101: 00000100:00100000:1.0:1789498298.296578:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498298.303540:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885536384 00000100:00100000:3.0:1789498298.303554:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885536384 00000100:00100000:3.0:1789498298.303607:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498298.303628:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea252b36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:5826:x1876424885536384:12345-0@lo:101: 00010000:00010000:3.0:1789498298.303646:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498298.303665:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17f42 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.303695:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.303716:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.303725:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6942ce2, rc 0) 00000100:00100000:3.0:1789498298.303784:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea252b36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5826:x1876424885536384:12345-0@lo:101: Request processed in 157us (7207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498298.303791:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498298.305992:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9c4fe1a going to sleep for 11 seconds 00000100:00100000:2.0:1789498298.306036:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f612ca04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536384:0@lo:101: 00010000:00010000:2.0:1789498298.306060:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498298.306071:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498298.306692:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e1343fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536512:0@lo:501: 00000100:00100000:2.0:1789498298.306762:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498298.306801:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037032dc4 going to sleep for 11 seconds 00000100:00100000:3.0:1789498298.306866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885536512 00000100:00100000:3.0:1789498298.306874:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885536512 00000100:00100000:3.0:1789498298.306928:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498298.306936:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000487cc609 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5826:x1876424885536512:12345-0@lo:501: 00000100:00100000:3.0:1789498298.307612:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000487cc609 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5826:x1876424885536512:12345-0@lo:501: Request processed in 676us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498298.307621:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498298.307926:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e1343fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536512:0@lo:501: 00000100:00100000:1.0:1789498298.307968:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a0ac71b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536640:0@lo:503: 00000100:00100000:1.0:1789498298.308015:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498298.308048:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9c4fe1a going to sleep for 11 seconds 00000100:00100000:2.0:1789498298.308162:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885536640 00000100:00100000:2.0:1789498298.308169:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885536640 00000100:00100000:2.0:1789498298.308258:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498298.308267:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9239b30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5826:x1876424885536640:12345-0@lo:503: 00000040:00080000:2.0:1789498298.308307:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498298.308397:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9239b30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5826:x1876424885536640:12345-0@lo:503: Request processed in 132us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498298.308404:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789498298.312695:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a0ac71b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536640:0@lo:503: 00000040:00080000:1.0:1789498298.318783:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789498298.319407:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789498298.319433:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498298.319467:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498298.319508:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498298.319559:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789498298.319562:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98ea90a2f000 10000000:01000000:2.0:1789498298.319565:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98ea90a2f000 10000000:01000000:2.0:1789498298.319569:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789498298.319575:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98ea90a2f000 from 1 10000000:01000000:2.0:1789498298.319577:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789498298.319615:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: 000000009b2fb691/0x3a6cb1946bc17f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498298.319623:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: 000000009b2fb691/0x3a6cb1946bc17f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498298.319633:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: 000000009b2fb691/0x3a6cb1946bc17f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498298.319655:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027b07348 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536768:0@lo:101: 00000100:00100000:2.0:1789498298.319732:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498298.319801:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037032dc4 going to sleep for 11 seconds 00000100:00100000:1.0:1789498298.320424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885536768 00000100:00100000:1.0:1789498298.320435:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885536768 00000100:00100000:1.0:1789498298.320508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498298.320517:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000233342ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5826:x1876424885536768:12345-0@lo:101: 00010000:00010000:1.0:1789498298.320532:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498298.320546:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008197533b/0x3a6cb1946bc17f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17f50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.320570:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008197533b/0x3a6cb1946bc17f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.320581:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008197533b/0x3a6cb1946bc17f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498298.320590:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008197533b, rc 0) 00000100:00100000:1.0:1789498298.320639:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000233342ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5826:x1876424885536768:12345-0@lo:101: Request processed in 125us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498298.320646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498298.320984:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027b07348 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536768:0@lo:101: 00010000:00010000:2.0:1789498298.321002:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: 000000009b2fb691/0x3a6cb1946bc17f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498298.321010:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: 000000009b2fb691/0x3a6cb1946bc17f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498298.321081:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027b07348 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536896:0@lo:501: 00000100:00100000:2.0:1789498298.321154:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498298.321177:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037032dc4 going to sleep for 11 seconds 00000100:00100000:0.0:1789498298.321289:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885536896 00000100:00100000:0.0:1789498298.321295:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885536896 00000100:00100000:0.0:1789498298.321323:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789498298.321329:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015ac4dfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5826:x1876424885536896:12345-0@lo:501: 00000100:00100000:0.0:1789498298.321682:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015ac4dfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5826:x1876424885536896:12345-0@lo:501: Request processed in 353us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498298.321690:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498298.321774:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027b07348 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885536896:0@lo:501: 00000100:00100000:2.0:1789498298.321803:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027b07348 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885537024:0@lo:503: 00000100:00100000:2.0:1789498298.321839:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498298.321871:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037032dc4 going to sleep for 11 seconds 00000100:00100000:0.0:1789498298.322002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885537024 00000100:00100000:0.0:1789498298.322013:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885537024 00000100:00100000:0.0:1789498298.322044:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789498298.322049:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d5c4750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5826:x1876424885537024:12345-0@lo:503: 00000100:00100000:0.0:1789498298.322454:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d5c4750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5826:x1876424885537024:12345-0@lo:503: Request processed in 404us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498298.322462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498298.323288:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027b07348 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885537024:0@lo:503: 00000100:00100000:2.0:1789498298.324399:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027b07348 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:5873:1876424885537152:0@lo:502: 00000100:00100000:2.0:1789498298.324475:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498298.324660:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037032dc4 going to sleep for 11 seconds 00000100:00100000:0.0:1789498298.324787:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885537152 00000100:00100000:0.0:1789498298.324795:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885537152 00000100:00100000:0.0:1789498298.324875:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789498298.324884:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004aff7a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5873:x1876424885537152:12345-0@lo:502: 00000100:00100000:0.0:1789498298.325391:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004aff7a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5873:x1876424885537152:12345-0@lo:502: Request processed in 508us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498298.325399:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498298.325511:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027b07348 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:5873:1876424885537152:0@lo:502: 00000020:01000004:3.0:1789498298.325584:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789498298.325599:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000025b24e0b) 00000020:00000080:3.0:1789498298.325618:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789498298.325697:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b5dc2ca from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789498298.325715:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009b5dc2ca from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789498298.325725:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009b5dc2ca 4 00010000:00080000:3.0:1789498298.325754:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000002d405bd@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1789498298.333359:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789498298.333784:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789498298.333823:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789498298.333836:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3a6cb1946bc17f65 00000100:00080000:3.0:1789498298.333846:0:5873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498298.333859:0:5873:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000002d405bd using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498298.334862:0:5873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001786b3ac x1876424885537280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498298.334955:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001786b3ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885537280:0@lo:38: 00000100:00100000:1.0:1789498298.335038:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789498298.336716:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789498298.338387:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d291296 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:5873:1876424885537408:0@lo:502: 00000100:00100000:2.0:1789498298.340426:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498298.340504:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885537408 00000100:00100000:2.0:1789498298.340513:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885537408 00000100:00100000:2.0:1789498298.340574:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498298.340585:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc85391 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5873:x1876424885537408:12345-0@lo:502: 00000100:00100000:2.0:1789498298.340871:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc85391 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5873:x1876424885537408:12345-0@lo:502: Request processed in 288us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498298.340893:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498298.340962:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f246b424 going to sleep for 11 seconds 00000100:00100000:2.0:1789498298.340988:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d291296 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:5873:1876424885537408:0@lo:502: 00000040:00080000:2.0:1789498298.341021:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789498298.341124:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789498298.341144:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789498298.341160:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: 000000009b2fb691/0x3a6cb1946bc17f50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498298.341172:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: 000000009b2fb691/0x3a6cb1946bc17f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789498298.341221:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789498298.341223:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789498298.341224:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498298.341226:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498298.341227:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498298.341228:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498298.341230:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789498298.341231:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789498298.341232:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789498298.341234:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789498298.341235:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498298.341236:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498298.341240:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789498298.341243:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789498298.341244:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789498298.341245:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498298.341246:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498298.341247:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498298.341248:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498298.341249:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789498298.341250:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789498298.341251:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789498298.341252:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789498298.341253:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498298.341254:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498298.341271:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789498298.341284:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d291296 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885537536:0@lo:253: 00000100:00100000:2.0:1789498298.341320:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498298.341341:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9f74e12 going to sleep for 11 seconds 00000100:00100000:0.0:1789498298.341483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885537536 00000100:00100000:0.0:1789498298.341489:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885537536 00000100:00100000:0.0:1789498298.341525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789498298.341532:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000620a2033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5826:x1876424885537536:12345-0@lo:253: 20000000:01000000:0.0:1789498298.341557:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789498298.341575:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789498298.344032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885537280 00000100:00100000:1.0:1789498298.344047:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885537280 00000100:00100000:1.0:1789498298.344109:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498298.344116:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a0ac71b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885537280:12345-0@lo:38: 00000100:00100000:1.0:1789498298.344206:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a0ac71b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885537280:12345-0@lo:38: Request processed in 89us (9168us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789498298.344213:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498298.344258:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789498298.344266:0:3304:0:(import.c:65:import_set_state_nolock()) 0000000002d405bd lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498298.344270:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789498298.344273:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001786b3ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885537280:0@lo:38: 20000000:01000000:0.0:1789498298.382349:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789498298.382373:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789498298.382436:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789498298.382442:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789498298.382463:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.382483:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.382491:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.382537:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.382552:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 12 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498298.382568:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b84c2f7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876424885537664:0@lo:104: 00000100:00100000:3.0:1789498298.382633:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498298.382722:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000234a32e6 going to sleep for 11 seconds 00000100:00100000:0.0:1789498298.382812:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885537664 00000100:00100000:0.0:1789498298.382823:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885537664 00000100:00100000:0.0:1789498298.382882:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498298.382890:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002607a1a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5861:x1876424885537664:12345-0@lo:104: 00010000:00010000:0.0:1789498298.382905:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383113:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789498298.383125:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002607a1a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5861:x1876424885537664:12345-0@lo:104: Request processed in 236us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498298.383132:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789498298.383154:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498298.383159:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383166:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cd22fcf8 already unused, calling callback (00000000ab0a79e0) 10000000:00010000:0.0:1789498298.383169:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383177:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498298.383183:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498298.383201:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789498298.383231:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383237:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498298.383257:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383263:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: 00000000cd22fcf8/0x3a6cb1946bc17f34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f3b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383282:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498298.383284:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498298.383285:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498298.383353:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df850af1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885537792:0@lo:103: 00000100:00100000:0.0:1789498298.383387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498298.383457:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885537792 00000100:00100000:0.0:1789498298.383461:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885537792 00010000:00010000:0.0:1789498298.383479:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 13 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498298.383500:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498298.383506:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d5a83f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3306:x1876424885537792:12345-0@lo:103: 00010000:00010000:0.0:1789498298.383518:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498298.383522:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 13 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383532:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 13 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383549:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383556:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789498298.383570:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001129731s 00010000:00010000:0.0:1789498298.383574:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383580:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383587:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383604:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383609:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000045ff655b already unused, calling callback (000000007e49e848) 00010000:00010000:0.0:1789498298.383612:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383619:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383626:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498298.383635:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498298.383664:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d5a83f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3306:x1876424885537792:12345-0@lo:103: Request processed in 159us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498298.383671:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498298.383716:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df850af1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885537792:0@lo:103: 00010000:00010000:3.0:1789498298.383868:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17f34 expref: 12 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498298.383880:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b84c2f7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876424885537664:0@lo:104: 00010000:00010000:3.0:1789498298.383892:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.383900:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.383905:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498298.383909:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498298.394659:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000620a2033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5826:x1876424885537536:12345-0@lo:253: Request processed in 53119us (53330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498298.394674:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789498298.394769:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d291296 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:5826:1876424885537536:0@lo:253: 10000000:01000000:0.0:1789498298.394785:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789498298.394789:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789498298.394792:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498298.394793:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498298.394794:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498298.394795:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498298.394796:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498298.394798:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498298.394799:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498298.394801:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789498298.394802:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789498298.394816:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498298.394818:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789498298.394833:0:5826:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789498298.401180:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498298.401726:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789498298.402287:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498298.402472:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789498298.403016:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498298.403355:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789498298.415370:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498298.415844:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789498298.416259:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498298.416612:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789498298.417135:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498298.417619:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1789498298.466691:0:5826:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789498298.509149:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789498298.509663:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1789498298.513650:0:5878:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789498298.513659:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789498298.522648:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789498298.523000:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789498298.529850:0:5826:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789498298.529889:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789498298.530746:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498298.533872:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789498298.536008:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789498298.536081:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789498298.540120:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789498298.540643:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789498298.542054:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789498298.542231:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789498298.542386:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789498298.542543:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789498298.547352:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789498298.549892:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789498298.550076:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789498298.553956:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789498298.558815:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789498298.559085:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789498298.559274:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789498298.559460:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789498298.559619:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789498298.559788:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789498298.559935:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789498298.560085:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789498298.560475:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789498298.560642:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789498298.569013:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789498298.570356:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789498298.571219:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789498298.571394:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789498298.574003:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789498298.574272:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789498298.574418:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789498298.574615:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789498298.574798:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789498298.574964:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789498298.575144:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789498298.575300:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789498298.575440:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789498298.575609:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789498298.579759:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789498298.619806:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789498298.669591:0:5826:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789498298.669640:0:5826:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba75c1c5f988 00100000:10000000:3.0:1789498298.669651:0:5826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789498298.670653:0:5826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498298.670669:0:5826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498298.670683:0:5826:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789498298.670715:0:5826:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789498298.732449:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789498298.732524:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789498298.732529:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789498299.244971:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498300.273532:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498301.291450:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498302.315423:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498303.348421:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498303.482464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789498303.482543:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789498303.482546:0:36:0:(import.c:65:import_set_state_nolock()) 0000000002d405bd lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498303.482566:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000002d405bd using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1789498303.482589:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006c6a10af x1876424885538048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498303.482601:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df850af1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885537920:0@lo:400: 00000100:00100000:0.0:1789498303.482633:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c6a10af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885538048:0@lo:38: 00000100:00100000:0.0:1789498303.483413:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498303.486825:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885538048 00000100:00100000:0.0:1789498303.486844:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885538048 00000100:00100000:0.0:1789498303.486896:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498303.486903:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e99fe63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876424885538048:12345-0@lo:38: 00010000:00080000:0.0:1789498303.486932:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1789498303.486971:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3a6cb1946bc17f73 00000004:00100000:0.0:1789498303.487011:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789498303.487130:0:5847:0:(import.c:65:import_set_state_nolock()) 0000000010e72ac5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498303.487209:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e99fe63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876424885538048:12345-0@lo:38: Request processed in 306us (3799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498303.487216:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789498303.487256:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006c6a10af x1876424885538048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789498303.487359:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789498303.487367:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789498303.487372:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789498303.487374:0:3304:0:(import.c:65:import_set_state_nolock()) 0000000002d405bd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789498303.487380:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c6a10af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885538048:0@lo:38: 00000100:00100000:1.0:1789498303.488373:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498303.492965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885537920 00000100:00100000:0.0:1789498303.493035:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885537920 00000100:00100000:1.0:1789498303.496656:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498303.496669:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006fcbb105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:3307:x1876424885537920:12345-0@lo:400: 00000100:00100000:0.0:1789498303.501450:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df850af1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885537920:0@lo:400: 00000100:00100000:1.0:1789498303.501755:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006fcbb105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:3307:x1876424885537920:12345-0@lo:400: Request processed in 5087us (13384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498303.501785:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000001:02000400:0.0:1789498304.293209:0:6122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789498304.366135:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789498305.009806:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789498305.009814:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98ea90a2f000 from 3 10000000:01000000:0.0:1789498305.009819:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789498305.009863:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: 000000005a11fed8/0x3a6cb1946bc17f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498305.009877:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: 000000005a11fed8/0x3a6cb1946bc17f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498305.009888:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: 000000005a11fed8/0x3a6cb1946bc17f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498305.009909:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df850af1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885538176:0@lo:101: 00000100:00100000:0.0:1789498305.009972:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498305.010061:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000008df8f1e2 going to sleep for 11 seconds 00000100:00100000:3.0:1789498305.015412:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885538176 00000100:00100000:3.0:1789498305.015426:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885538176 00000100:00100000:3.0:1789498305.015555:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789498305.015564:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af4e17f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5842:x1876424885538176:12345-0@lo:101: 00010000:00010000:3.0:1789498305.015593:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498305.015616:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17f7a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498305.015644:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498305.015654:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7163091/0x3a6cb1946bc17f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498305.015663:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7163091, rc 0) 00000100:00100000:3.0:1789498305.015784:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af4e17f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885538176:12345-0@lo:101: Request processed in 221us (5812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498305.015790:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789498305.015850:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df850af1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885538176:0@lo:101: 00010000:00010000:3.0:1789498305.015867:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: 000000005a11fed8/0x3a6cb1946bc17f7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498305.015876:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: 000000005a11fed8/0x3a6cb1946bc17f7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498305.015933:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b84c2f7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885538304:0@lo:256: 00000100:00100000:3.0:1789498305.015968:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498305.015997:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000075770aed going to sleep for 11 seconds 00000100:00100000:3.0:1789498305.016010:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885538304 00000100:00100000:3.0:1789498305.016014:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885538304 00000100:00100000:3.0:1789498305.016034:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498305.016047:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009bfb5b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885538304:12345-0@lo:256: 20000000:01000000:3.0:1789498305.016061:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789498305.016075:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789498305.016078:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789498305.017324:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009bfb5b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885538304:12345-0@lo:256: Request processed in 1274us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498305.017332:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498305.017367:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b84c2f7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885538304:0@lo:256: 10000000:01000000:3.0:1789498305.017402:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789498305.017415:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: 000000005a11fed8/0x3a6cb1946bc17f7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498305.017422:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: 000000005a11fed8/0x3a6cb1946bc17f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498305.398337:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498306.411320:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498307.435566:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498308.459568:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498308.588432:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea83be6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885538432:0@lo:400: 00000100:00100000:0.0:1789498308.588556:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498308.588652:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b2ebdf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885538560:0@lo:400: 00000100:00100000:0.0:1789498308.588684:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498308.588731:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885538560 00000100:00100000:0.0:1789498308.588741:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885538560 00000100:00100000:0.0:1789498308.588800:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498308.588809:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006c6a10af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885538560:12345-0@lo:400: 00000100:00100000:0.0:1789498308.588873:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006c6a10af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885538560:12345-0@lo:400: Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498308.588881:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789498308.588929:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000b2ebdf0 x1876424885538560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498308.588947:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b2ebdf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885538560:0@lo:400: 00000100:00100000:1.0:1789498308.589017:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885538432 00000100:00100000:1.0:1789498308.589023:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885538432 00000100:00100000:1.0:1789498308.589064:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498308.589070:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc9ddb34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:3308:x1876424885538432:12345-0@lo:400: 00000100:00100000:1.0:1789498308.589140:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc9ddb34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:3308:x1876424885538432:12345-0@lo:400: Request processed in 70us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498308.589146:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789498308.589231:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea83be6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885538432:0@lo:400: 00010000:00010000:1.0:1789498309.485564:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789498309.521942:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff073dea00 20000000:00000080:3.0:1789498309.521960:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98ea87ecbc00 uarg=0000000000000000 20000000:01000000:3.0:1789498309.521993:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789498309.522002:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789498309.522008:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789498309.522428:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789498309.522440:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789498309.526468:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498309.526771:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789498309.526833:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789498309.526888:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789498309.526910:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789498309.526931:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498309.526962:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498309.526969:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498309.527084:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498309.528684:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 11 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498309.528705:0:6324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b84c2f7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1876424885538688:0@lo:104: 00000100:00100000:3.0:1789498309.528787:0:6324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498309.528877:0:6324:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bf987c1 going to sleep for 11 seconds 00000100:00100000:0.0:1789498309.528920:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885538688 00000100:00100000:0.0:1789498309.528928:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885538688 00000100:00100000:0.0:1789498309.529023:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498309.529031:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b392f540 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:6324:x1876424885538688:12345-0@lo:104: 00010000:00010000:0.0:1789498309.529044:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498309.529135:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789498309.529141:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b392f540 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:6324:x1876424885538688:12345-0@lo:104: Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498309.529147:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789498309.529286:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498309.529293:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529301:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000c99295a already unused, calling callback (00000000ab0a79e0) 10000000:00010000:2.0:1789498309.529304:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529313:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498309.529320:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498309.529326:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498309.529402:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529426:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498309.529447:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529453:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: 000000000c99295a/0x3a6cb1946bc17f42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f49 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529471:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498309.529472:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498309.529474:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498309.529495:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e3af67f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885538816:0@lo:103: 00000100:00100000:2.0:1789498309.529540:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498309.529586:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885538816 00000100:00100000:2.0:1789498309.529591:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885538816 00010000:00010000:2.0:1789498309.529610:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 12 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498309.529633:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498309.529639:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a995c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:3306:x1876424885538816:12345-0@lo:103: 00010000:00010000:2.0:1789498309.529650:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498309.529655:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 12 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529663:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 12 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529679:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529699:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529716:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529721:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529727:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529732:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529737:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000045ff655b already unused, calling callback (000000007e49e848) 00010000:00010000:2.0:1789498309.529740:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529747:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529755:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498309.529763:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498309.529792:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a995c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:3306:x1876424885538816:12345-0@lo:103: Request processed in 154us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498309.529799:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498309.529838:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e3af67f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885538816:0@lo:103: 00010000:00010000:3.0:1789498309.529972:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6942ce2/0x3a6cb1946bc17f49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17f42 expref: 11 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498309.529983:0:6324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b84c2f7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1876424885538688:0@lo:104: 00010000:00010000:3.0:1789498309.530007:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498309.530015:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498309.530020:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498309.530025:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045ff655b/0x3a6cb1946bc17f88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498310.509608:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498311.531625:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498312.566907:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498313.580414:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498313.707519:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000894ce947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885539072:0@lo:400: 00000100:00100000:0.0:1789498313.707850:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b84c2f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885538944:0@lo:400: 00000100:00100000:0.0:1789498313.707899:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498313.707993:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498313.708438:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885538944 00000100:00100000:1.0:1789498313.708457:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885538944 00000100:00100000:1.0:1789498313.708507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789498313.708515:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f1d2dc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:3307:x1876424885538944:12345-0@lo:400: 00000100:00100000:1.0:1789498313.708576:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f1d2dc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:3307:x1876424885538944:12345-0@lo:400: Request processed in 62us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498313.708584:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789498313.708808:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b84c2f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885538944:0@lo:400: 00000100:00100000:0.0:1789498313.708899:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885539072 00000100:00100000:0.0:1789498313.708904:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885539072 00000100:00100000:0.0:1789498313.708935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498313.708941:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061ddf14b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885539072:12345-0@lo:400: 00000100:00100000:0.0:1789498313.708982:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061ddf14b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885539072:12345-0@lo:400: Request processed in 42us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498313.708989:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789498313.709021:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000894ce947 x1876424885539072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498313.709032:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000894ce947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885539072:0@lo:400: 10000000:01000000:3.0:1789498314.220817:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498314.220826:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea90a2f000 from 1 10000000:01000000:3.0:1789498314.220831:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498314.220878:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: 00000000e6942ce2/0x3a6cb1946bc17f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498314.220907:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: 00000000e6942ce2/0x3a6cb1946bc17f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498314.220918:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: 00000000e6942ce2/0x3a6cb1946bc17f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498314.220946:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000404b18e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885539200:0@lo:101: 00000100:00100000:3.0:1789498314.221021:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498314.221079:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9e84546 going to sleep for 11 seconds 00000100:00100000:1.0:1789498314.221151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885539200 00000100:00100000:1.0:1789498314.221160:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885539200 00000100:00100000:1.0:1789498314.221215:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789498314.221223:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d7b1aa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:5842:x1876424885539200:12345-0@lo:101: 00010000:00010000:1.0:1789498314.221237:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498314.221254:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd22fcf8/0x3a6cb1946bc17f96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17f8f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498314.221276:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd22fcf8/0x3a6cb1946bc17f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498314.221286:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd22fcf8/0x3a6cb1946bc17f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498314.221295:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd22fcf8, rc 0) 00000100:00100000:1.0:1789498314.221337:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d7b1aa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885539200:12345-0@lo:101: Request processed in 115us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498314.221343:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789498314.221406:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000404b18e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885539200:0@lo:101: 00010000:00010000:1.0:1789498314.221435:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: 00000000e6942ce2/0x3a6cb1946bc17f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498314.221449:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: 00000000e6942ce2/0x3a6cb1946bc17f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498314.221499:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3031f33 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885539328:0@lo:501: 00000100:00100000:1.0:1789498314.221520:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498314.221554:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef4b96da going to sleep for 11 seconds 00000100:00100000:3.0:1789498314.221910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885539328 00000100:00100000:3.0:1789498314.221916:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885539328 00000100:00100000:3.0:1789498314.221946:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498314.221951:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f663a2b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885539328:12345-0@lo:501: 00000100:00100000:3.0:1789498314.222211:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f663a2b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885539328:12345-0@lo:501: Request processed in 260us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498314.222217:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498314.222356:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3031f33 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885539328:0@lo:501: 00000100:00100000:1.0:1789498314.222385:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3031f33 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885539456:0@lo:503: 00000100:00100000:1.0:1789498314.222614:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498314.222649:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef4b96da going to sleep for 11 seconds 00000100:00100000:3.0:1789498314.223034:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885539456 00000100:00100000:3.0:1789498314.223048:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885539456 00000100:00100000:3.0:1789498314.223085:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498314.223113:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006755b69b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885539456:12345-0@lo:503: 00000100:00100000:3.0:1789498314.223253:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006755b69b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885539456:12345-0@lo:503: Request processed in 142us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498314.223260:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498314.223410:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3031f33 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885539456:0@lo:503: 00000100:00100000:1.0:1789498314.224020:0:6600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3031f33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6600:1876424885539584:0@lo:502: 00000100:00100000:1.0:1789498314.224071:0:6600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498314.224163:0:6600:0:(client.c:2716:ptlrpc_set_wait()) set 000000003353fc39 going to sleep for 11 seconds 00000100:00100000:3.0:1789498314.224275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885539584 00000100:00100000:3.0:1789498314.224281:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885539584 00000100:00100000:3.0:1789498314.224354:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789498314.224363:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078cb2f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6600:x1876424885539584:12345-0@lo:502: 00000100:00100000:3.0:1789498314.227788:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078cb2f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6600:x1876424885539584:12345-0@lo:502: Request processed in 3416us (3707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498314.227807:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789498314.228068:0:6600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3031f33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6600:1876424885539584:0@lo:502: 00000020:01000000:1.0:1789498314.228184:0:6600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498314.228194:0:6600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498314.228196:0:6600:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789498314.228204:0:6600:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98ea90a2f000 00000020:00000080:1.0:1789498314.228208:0:6600:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789498314.228266:0:6600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6600:1876424885539712:0@lo:502: 00000100:00100000:1.0:1789498314.228319:0:6600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498314.228553:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885539712 00000100:00100000:1.0:1789498314.228560:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885539712 00000100:00100000:1.0:1789498314.228608:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789498314.228617:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6600:x1876424885539712:12345-0@lo:502: 00000100:00100000:1.0:1789498314.229006:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6600:x1876424885539712:12345-0@lo:502: Request processed in 388us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498314.229015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789498314.229068:0:6600:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85065240 going to sleep for 11 seconds 00000100:00100000:1.0:1789498314.229086:0:6600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6600:1876424885539712:0@lo:502: 00000020:01000000:1.0:1789498314.229133:0:6600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498314.229138:0:6600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498314.229141:0:6600:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789498314.229145:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789498314.231281:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789498314.231316:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498314.231329:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498314.231343:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498314.604481:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498315.628504:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789498316.302141:0:6699:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789498316.302145:0:6699:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789498316.302247:0:6699:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98eabd51c800 00000020:01000004:3.0:1789498316.302259:0:6699:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789498316.302269:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789498316.302279:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98ea83f2b380) 00000020:00000080:3.0:1789498316.302290:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789498316.316294:0:6699:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789498316.316549:0:6699:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789498316.334394:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789498316.341945:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789498316.341995:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789498316.342068:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789498316.342222:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789498316.342602:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789498316.342613:0:6699:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789498316.342625:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3a6cb1946bc17fa4 00000020:01000004:1.0:1789498316.342632:0:6699:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789498316.342651:0:6699:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789498316.342655:0:6699:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789498316.342662:0:6699:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789498316.342667:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789498316.342679:0:6699:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98ea83f799c0) 00000020:00000080:1.0:1789498316.342688:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1789498316.343973:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498316.344247:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789498316.344253:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789498316.345254:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789498316.345263:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789498316.345715:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789498316.345723:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789498316.347273:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498316.347489:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789498316.347497:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789498316.348527:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789498316.348537:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789498316.371542:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498316.371806:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789498316.371813:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789498316.372953:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789498316.372962:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789498316.374632:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789498316.374654:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789498316.376860:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498316.377086:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789498316.377248:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789498316.377852:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789498316.377859:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789498316.416970:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498316.417282:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789498316.417290:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789498316.419038:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789498316.419053:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789498316.419524:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789498316.419547:0:6699:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789498316.419553:0:6699:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789498316.447623:0:6699:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789498316.447662:0:6699:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789498316.447667:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789498316.447668:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498316.447670:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498316.447671:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498316.447673:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498316.447674:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498316.447676:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498316.447677:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789498316.447678:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789498316.447763:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498316.447766:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789498316.447770:0:6699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789498316.447773:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789498316.447774:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498316.447776:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498316.447777:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498316.447778:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498316.447779:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498316.447780:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498316.447791:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789498316.447792:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789498316.447793:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498316.447795:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789498316.447821:0:6699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789498316.447840:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885539840:0@lo:253: 00000100:00100000:2.0:1789498316.447905:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.447993:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62ef300 going to sleep for 11 seconds 00000100:00100000:3.0:1789498316.448315:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885539840 00000100:00100000:3.0:1789498316.448323:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885539840 00000100:00100000:3.0:1789498316.448422:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789498316.448431:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885539840:12345-0@lo:253: 20000000:01000000:3.0:1789498316.448459:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789498316.448464:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789498316.448469:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789498316.448473:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789498316.449977:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498316.450228:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789498316.450242:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789498316.450280:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789498316.450288:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789498316.450315:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789498316.450360:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789498316.450731:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789498316.450760:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.120@tcp 20000000:01000000:3.0:1789498316.450762:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.120@tcp (null) (null) (null) 00000040:00080000:3.0:1789498316.450800:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789498316.450808:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789498316.450857:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789498316.450865:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.120@tcp (null) (null) 00000040:00080000:3.0:1789498316.450901:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789498316.450911:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789498316.450960:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789498316.451014:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789498316.453929:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789498316.453963:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.120@tcp 20000000:01000000:0.0:1789498316.453966:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.120@tcp (null) (null) (null) 00000040:00080000:0.0:1789498316.454001:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789498316.454009:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789498316.454036:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789498316.454043:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.120@tcp (null) (null) 00000040:00080000:0.0:1789498316.454084:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789498316.454128:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789498316.454163:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789498316.454195:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789498316.454211:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789498316.454214:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789498316.454217:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789498316.454229:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789498316.454232:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789498316.454263:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789498316.454266:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789498316.455383:0:6714:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789498316.455456:0:6714:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789498316.455526:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789498316.455874:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789498316.455921:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789498316.455959:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789498316.455974:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789498316.455976:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789498316.456658:0:6715:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789498316.456724:0:6715:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789498316.456784:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789498316.457140:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789498316.457185:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789498316.457244:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789498316.457262:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789498316.457264:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789498316.457876:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789498316.458076:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789498316.458258:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789498316.458316:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1789498316.458332:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789498316.458334:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789498316.458344:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789498316.458363:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.458391:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc17ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.458400:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.458407:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.458414:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.458453:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.458468:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17f57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 12 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.458482:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885539968:0@lo:104: 00000100:00100000:1.0:1789498316.458552:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789498316.458641:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.458668:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17ee7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 12 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.458677:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885540096:0@lo:104: 00000100:00100000:1.0:1789498316.458708:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789498316.458951:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc17ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.458960:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc17ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 12 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.458968:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885540224:0@lo:104: 00000100:00100000:1.0:1789498316.458988:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498316.459013:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885539968 00000100:00100000:0.0:1789498316.459021:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885539968 00000100:00100000:2.0:1789498316.459074:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885540096 00000100:00100000:2.0:1789498316.459079:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885540096 00000100:00100000:2.0:1789498316.459120:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498316.459129:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:5839:x1876424885539968:12345-0@lo:104: 00010000:00010000:2.0:1789498316.459142:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459200:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498316.459206:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:5839:x1876424885539968:12345-0@lo:104: Request processed in 79us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.459213:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498316.459231:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498316.459237:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5839:x1876424885540096:12345-0@lo:104: 00010000:00010000:2.0:1789498316.459245:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459278:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789498316.459283:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5839:x1876424885540096:12345-0@lo:104: Request processed in 47us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.459289:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789498316.459308:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498316.459314:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459322:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554800 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498316.459326:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459334:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498316.459350:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498316.459356:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789498316.459413:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17f50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459420:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498316.459437:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17f50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459444:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17f50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f57 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459459:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498316.459463:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459469:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab640e000 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498316.459472:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459477:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498316.459484:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498316.459489:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789498316.459509:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459516:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498316.459521:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ee0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459528:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ee7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459540:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498316.459542:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498316.459543:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498316.459557:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885540352:0@lo:103: 00000100:00100000:2.0:1789498316.459599:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.459623:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498316.459629:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885540480:0@lo:103: 00000100:00100000:2.0:1789498316.459650:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.459680:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885540352 00010000:00010000:3.0:1789498316.459762:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498316.459806:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885540352 00010000:00010000:2.0:1789498316.459827:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17f57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 13 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498316.459854:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885540480 00000100:00100000:2.0:1789498316.459857:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885540480 00010000:00010000:2.0:1789498316.459868:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17ee7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 14 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498316.459881:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498316.459886:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:3305:x1876424885540352:12345-0@lo:103: 00010000:00010000:2.0:1789498316.459906:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498316.459912:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17f57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 14 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459923:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17f57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 14 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.459939:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498316.459971:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:3305:x1876424885540352:12345-0@lo:103: Request processed in 84us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.459977:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498316.459989:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498316.459994:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3305:x1876424885540480:12345-0@lo:103: 00010000:00010000:2.0:1789498316.460002:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498316.460006:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17ee7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 13 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.460014:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17ee7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 13 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.460023:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498316.460043:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3305:x1876424885540480:12345-0@lo:103: Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.460049:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498316.460082:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885540480:0@lo:103: 00000100:00100000:2.0:1789498316.460112:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885540352:0@lo:103: 00000100:00100000:1.0:1789498316.460293:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea857413c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789498316.460308:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17f57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17f50 expref: 12 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.460319:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885539968:0@lo:104: 00010000:00010000:1.0:1789498316.460328:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17ee0 expref: 11 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.460337:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885540096:0@lo:104: 00000100:00100000:2.0:1789498316.460391:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885540224 00000100:00100000:2.0:1789498316.460396:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885540224 00000100:00100000:2.0:1789498316.460423:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498316.460429:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5839:x1876424885540224:12345-0@lo:104: 00010000:00010000:2.0:1789498316.460436:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eab640fa00/0x3a6cb1946bc17ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.460517:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498316.460522:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5839:x1876424885540224:12345-0@lo:104: Request processed in 95us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.460528:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498316.460633:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885540224:0@lo:104: 00010000:00010000:1.0:1789498316.460651:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.460753:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498316.460758:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab640fa00/0x3a6cb1946bc17ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.460765:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab640fa00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498316.460769:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab640fa00/0x3a6cb1946bc17ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.460776:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab640fa00/0x3a6cb1946bc17ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498316.460784:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab640fa00/0x3a6cb1946bc17ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498316.460789:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498316.460854:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab640fa00/0x3a6cb1946bc17ec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.460861:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498316.460887:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab640fa00/0x3a6cb1946bc17ec4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.460901:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab640fa00/0x3a6cb1946bc17ec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ecb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.460915:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498316.460916:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498316.460918:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498316.460958:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885540608:0@lo:103: 00000100:00100000:1.0:1789498316.460995:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498316.461071:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885540608 00000100:00100000:3.0:1789498316.461075:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885540608 00010000:00010000:3.0:1789498316.461120:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc17ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 11 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498316.461144:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498316.461151:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:3307:x1876424885540608:12345-0@lo:103: 00010000:00010000:3.0:1789498316.461160:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498316.461165:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc17ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 11 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461175:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc17ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 11 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461185:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc17ecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17ec4 expref: 11 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461196:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461204:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461227:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461233:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461239:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461245:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461251:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab640ec00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498316.461255:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461262:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461273:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.461281:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498316.461308:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:3307:x1876424885540608:12345-0@lo:103: Request processed in 159us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498316.461314:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498316.461395:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885540608:0@lo:103: 00010000:00010000:1.0:1789498316.461413:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.461421:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.461428:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789498316.461440:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789498316.564439:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:6699:x1876424885539840:12345-0@lo:253: Request processed in 115996us (116520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498316.564453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498316.564600:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885539840:0@lo:253: 10000000:01000000:2.0:1789498316.564615:0:6699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789498316.564619:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789498316.564620:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498316.564622:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498316.564623:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789498316.564624:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498316.564625:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498316.564626:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498316.564628:0:6699:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789498316.564630:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498316.564631:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789498316.564701:0:6699:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98eabd51c800 from lustre-OST0000 10000000:01000000:2.0:1789498316.564830:0:6699:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789498316.564834:0:6699:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789498316.564841:0:6699:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98ea83f28000 local copy 10000000:01000000:2.0:1789498316.564845:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789498316.564946:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.564959:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.564979:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498316.564996:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885540736:0@lo:101: 00000100:00100000:2.0:1789498316.565205:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.566258:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62ef3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498316.570836:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885540736 00000100:00100000:3.0:1789498316.570938:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885540736 00000100:00100000:2.0:1789498316.571229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789498316.571241:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:6699:x1876424885540736:12345-0@lo:101: 00010000:00010000:2.0:1789498316.571258:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498316.571279:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17fb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.571305:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fb9 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.571316:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fb9 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.571325:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554400, rc 0) 00000100:00100000:2.0:1789498316.571420:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:6699:x1876424885540736:12345-0@lo:101: Request processed in 181us (6214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.571427:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498316.571593:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885540736:0@lo:101: 00010000:00010000:3.0:1789498316.571614:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.571623:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498316.571844:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885540864:0@lo:501: 00000100:00100000:3.0:1789498316.571949:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498316.571988:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.572185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885540864 00000100:00100000:1.0:1789498316.572191:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885540864 00000100:00100000:1.0:1789498316.572228:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789498316.572235:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:6699:x1876424885540864:12345-0@lo:501: 00000100:00100000:1.0:1789498316.572472:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:6699:x1876424885540864:12345-0@lo:501: Request processed in 237us (521us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789498316.572480:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498316.572611:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885540864:0@lo:501: 10000000:01000000:3.0:1789498316.572626:0:6699:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789498316.572657:0:6699:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789498316.572663:0:6699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.572673:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.572680:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.572705:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498316.572800:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498316.572807:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.572817:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554800 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498316.572820:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.572830:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498316.572848:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498316.572854:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789498316.572942:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.572949:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498316.572980:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.572989:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498316.572990:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498316.572992:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498316.573000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498316.573228:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885540992:0@lo:103: 00000100:00100000:1.0:1789498316.573266:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789498316.574057:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab6554800/0x3a6cb1946bc17fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3a6cb1946bc17fc0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498316.574132:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98eabd51c800 10000000:01000000:3.0:1789498316.574139:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789498316.574155:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98ea83f28000 10000000:01000000:3.0:1789498316.574158:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789498316.574162:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98ea83f28000 from 1 10000000:01000000:3.0:1789498316.574164:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789498316.574190:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.574198:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.574207:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498316.574223:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541120:0@lo:101: 00000100:00100000:3.0:1789498316.574261:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498316.574277:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.575246:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885541120 00000100:00100000:1.0:1789498316.575257:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885541120 00000100:00100000:1.0:1789498316.575311:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498316.575321:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+10:6699:x1876424885541120:12345-0@lo:101: 00010000:00010000:1.0:1789498316.575335:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498316.575351:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17fc7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.575390:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fc7 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.575402:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fc7 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.575424:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640ec00, rc 0) 00000100:00100000:1.0:1789498316.575478:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:6699:x1876424885541120:12345-0@lo:101: Request processed in 158us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.575484:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498316.577233:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541120:0@lo:101: 00010000:00010000:3.0:1789498316.577259:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17fce expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.577271:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17fce expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498316.577295:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789498316.577315:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17fce expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.577323:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17fce expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498316.577352:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789498316.577357:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498316.577364:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789498316.577367:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789498316.577413:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.577421:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.577431:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498316.577450:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541248:0@lo:101: 00000100:00100000:3.0:1789498316.577508:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498316.577558:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.577624:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885541248 00000100:00100000:1.0:1789498316.577632:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885541248 00000100:00100000:1.0:1789498316.577688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789498316.577700:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:6699:x1876424885541248:12345-0@lo:101: 00010000:00010000:1.0:1789498316.577726:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498316.577741:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17fd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.577764:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.577775:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.577784:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640f800, rc 0) 00000100:00100000:1.0:1789498316.577823:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885541248:12345-0@lo:101: Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.577830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498316.578237:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541248:0@lo:101: 00010000:00010000:3.0:1789498316.578249:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.578256:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498316.578359:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541376:0@lo:501: 00000100:00100000:3.0:1789498316.578399:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498316.578431:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.579228:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885541376 00000100:00100000:1.0:1789498316.579237:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885541376 00000100:00100000:1.0:1789498316.579288:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498316.579297:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885541376:12345-0@lo:501: 00000100:00100000:1.0:1789498316.579583:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885541376:12345-0@lo:501: Request processed in 287us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.579600:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498316.579649:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541376:0@lo:501: 00000100:00100000:1.0:1789498316.579691:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541504:0@lo:503: 00000100:00100000:1.0:1789498316.580952:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498316.581002:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85741f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498316.581233:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885541504 00000100:00100000:3.0:1789498316.581252:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885541504 00000100:00100000:3.0:1789498316.581308:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498316.581317:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885541504:12345-0@lo:503: 00000100:00100000:3.0:1789498316.581543:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885541504:12345-0@lo:503: Request processed in 227us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498316.581551:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789498316.581693:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541504:0@lo:503: 00000100:00100000:2.0:1789498316.581962:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885540992 00000100:00100000:2.0:1789498316.581967:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885540992 00000100:00100000:2.0:1789498316.582185:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498316.582195:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:3307:x1876424885540992:12345-0@lo:103: 00010000:00010000:2.0:1789498316.582207:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498316.582234:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc17fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc17fb9 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.582251:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498316.582348:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:3307:x1876424885540992:12345-0@lo:103: Request processed in 156us (9082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.582354:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1789498316.582609:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789498316.582687:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541632:0@lo:502: 00000100:00100000:1.0:1789498316.582743:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498316.582783:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85741f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498316.582968:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885541632 00000100:00100000:2.0:1789498316.582973:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885541632 00000100:00100000:2.0:1789498316.583019:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789498316.583027:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:6699:x1876424885541632:12345-0@lo:502: 00000100:00100000:2.0:1789498316.583400:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:6699:x1876424885541632:12345-0@lo:502: Request processed in 372us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.583407:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789498316.583832:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541632:0@lo:502: 00000040:00080000:1.0:1789498316.584426:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789498316.584487:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789498316.584526:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789498316.584580:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789498316.584621:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789498316.584670:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789498316.584775:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541760:0@lo:502: 00000100:00100000:1.0:1789498316.584835:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498316.584924:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85741f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498316.585246:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885540992:0@lo:103: 00000100:00100000:2.0:1789498316.585362:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885541760 00000100:00100000:2.0:1789498316.585380:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885541760 00000100:00100000:2.0:1789498316.585464:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789498316.585474:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:6699:x1876424885541760:12345-0@lo:502: 00000100:00100000:2.0:1789498316.585691:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:6699:x1876424885541760:12345-0@lo:502: Request processed in 218us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498316.585698:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789498316.585788:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541760:0@lo:502: 00000040:00080000:1.0:1789498316.585905:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789498316.585918:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789498316.588631:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789498316.588652:0:6717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789498316.588658:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498316.588666:0:6717:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789498316.588673:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498316.588687:0:6717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98ea83f78000) 00000020:00000080:1.0:1789498316.588808:0:6717:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789498316.588817:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789498316.588904:0:6717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98eabd51c800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789498316.588912:0:6717:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789498316.588921:0:6717:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3a6cb1946bc17fea 00010000:00010000:1.0:1789498316.602281:0:6717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789498316.602677:0:6717:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789498316.607970:0:6717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789498316.608297:0:6717:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789498316.616643:0:6717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789498316.617652:0:6717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789498316.619817:0:6717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789498316.619829:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498316.619836:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498316.619838:0:6717:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789498316.619842:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498316.619845:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498316.619847:0:6717:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789498316.619850:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789498316.619852:0:6717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789498316.619978:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498316.619982:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498316.619984:0:6717:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789498316.619987:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789498316.620317:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789498316.620345:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789498316.620360:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.620385:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498316.620394:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eabd51c800 from 1 10000000:01000000:1.0:1789498316.620397:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789498316.620437:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.620445:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.620456:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.620485:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541888:0@lo:101: 00000100:00100000:1.0:1789498316.620557:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498316.620616:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea857413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498316.620676:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885541888 00000100:00100000:3.0:1789498316.620684:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885541888 00000100:00100000:3.0:1789498316.620814:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789498316.620824:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:6699:x1876424885541888:12345-0@lo:101: 00010000:00010000:3.0:1789498316.620839:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498316.620852:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17ff1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.620974:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.620985:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.621000:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498316.621353:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885541888:12345-0@lo:101: Request processed in 530us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498316.621360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789498316.621451:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885541888:0@lo:101: 00010000:00010000:1.0:1789498316.621469:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.621479:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.621573:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542016:0@lo:501: 00000100:00100000:1.0:1789498316.621604:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498316.621676:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea857413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498316.631615:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885542016 00000100:00100000:0.0:1789498316.631629:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885542016 00000100:00100000:0.0:1789498316.631685:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789498316.631696:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542016:12345-0@lo:501: 00000100:00100000:0.0:1789498316.632046:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542016:12345-0@lo:501: Request processed in 351us (10439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498316.632054:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789498316.632456:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542016:0@lo:501: 00000100:00100000:1.0:1789498316.632509:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542144:0@lo:503: 00000100:00100000:1.0:1789498316.632559:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498316.632589:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea857413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498316.632645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885542144 00000100:00100000:0.0:1789498316.632650:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885542144 00000100:00100000:0.0:1789498316.632684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789498316.632692:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542144:12345-0@lo:503: 00000100:00100000:1.0:1789498316.633348:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542144:12345-0@lo:503: Request processed in 655us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.633357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789498316.633508:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542144:0@lo:503: 00000040:00080000:0.0:1789498316.633848:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789498316.633982:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542272:0@lo:502: 00000100:00100000:0.0:1789498316.634230:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498316.634262:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.634388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885542272 00000100:00100000:1.0:1789498316.634394:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885542272 00000100:00100000:1.0:1789498316.634427:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789498316.634436:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542272:12345-0@lo:502: 00000100:00100000:1.0:1789498316.634632:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542272:12345-0@lo:502: Request processed in 196us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.634646:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789498316.634834:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542272:0@lo:502: 00000040:00080000:2.0:1789498316.635328:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789498316.635399:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789498316.635434:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542400:0@lo:502: 00000100:00100000:2.0:1789498316.635486:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.635516:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea89b4b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.635595:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885542400 00000100:00100000:1.0:1789498316.635600:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885542400 00000100:00100000:1.0:1789498316.635628:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789498316.635636:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542400:12345-0@lo:502: 00000100:00100000:1.0:1789498316.635984:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542400:12345-0@lo:502: Request processed in 348us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.635992:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789498316.636426:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542400:0@lo:502: 00000040:00080000:2.0:1789498316.636558:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789498316.636569:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789498316.637476:0:6721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498316.637489:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498316.637492:0:6721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789498316.637502:0:6721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98eabd51c800 00000020:00000080:1.0:1789498316.637504:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498316.637524:0:6721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498316.637527:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498316.637529:0:6721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789498316.637531:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789498316.637688:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789498316.637784:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498316.637843:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.637855:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498316.637906:0:6699:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789498316.637909:0:6699:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98eabd51c800 10000000:01000000:2.0:1789498316.637911:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98eabd51c800 10000000:01000000:2.0:1789498316.637916:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789498316.637921:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98eabd51c800 from 1 10000000:01000000:2.0:1789498316.637924:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789498316.637957:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.637966:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.637975:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498316.637994:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542528:0@lo:101: 00000100:00100000:2.0:1789498316.638058:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498316.638233:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885542528 00000100:00100000:1.0:1789498316.638240:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885542528 00000100:00100000:1.0:1789498316.638285:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789498316.638295:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885542528:12345-0@lo:101: 00010000:00010000:1.0:1789498316.638308:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498316.638322:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc17fff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.638345:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.638356:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.638388:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640fa00, rc 0) 00000100:00100000:1.0:1789498316.638425:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885542528:12345-0@lo:101: Request processed in 131us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.638432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789498316.638551:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9847a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789498316.638573:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542528:0@lo:101: 00010000:00010000:2.0:1789498316.638589:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.638604:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498316.638689:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542656:0@lo:501: 00000100:00100000:2.0:1789498316.638727:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.638785:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9847a1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.639213:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885542656 00000100:00100000:1.0:1789498316.639220:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885542656 00000100:00100000:1.0:1789498316.639251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789498316.639258:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885542656:12345-0@lo:501: 00000100:00100000:1.0:1789498316.640396:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885542656:12345-0@lo:501: Request processed in 1132us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.640409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789498316.640570:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542656:0@lo:501: 00000100:00100000:2.0:1789498316.640629:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542784:0@lo:503: 00000100:00100000:2.0:1789498316.640682:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.640819:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9847a1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.640856:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885542784 00000100:00100000:1.0:1789498316.640934:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885542784 00000100:00100000:1.0:1789498316.641082:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789498316.641286:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885542784:12345-0@lo:503: 00000100:00100000:1.0:1789498316.643457:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885542784:12345-0@lo:503: Request processed in 2354us (2763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.643472:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789498316.643571:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542784:0@lo:503: 00000040:00080000:2.0:1789498316.644353:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498316.644481:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542912:0@lo:502: 00000100:00100000:2.0:1789498316.644539:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.644622:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9847a1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498316.644663:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885542912 00000100:00100000:3.0:1789498316.644671:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885542912 00000100:00100000:3.0:1789498316.644821:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789498316.644832:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885542912:12345-0@lo:502: 00000100:00100000:3.0:1789498316.645306:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885542912:12345-0@lo:502: Request processed in 473us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498316.645314:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789498316.645400:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885542912:0@lo:502: 00000040:00080000:2.0:1789498316.645663:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789498316.645727:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789498316.645763:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789498316.645808:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789498316.645844:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789498316.645904:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789498316.645939:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789498316.645971:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789498316.646028:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789498316.646066:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789498316.646146:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789498316.646203:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789498316.646244:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789498316.646280:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789498316.646333:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789498316.646400:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789498316.646438:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789498316.646507:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789498316.646548:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789498316.646582:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789498316.646627:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789498316.646664:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789498316.646699:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789498316.646755:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789498316.646793:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789498316.646828:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789498316.646878:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789498316.646916:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789498316.646964:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885543040:0@lo:502: 00000100:00100000:2.0:1789498316.647037:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.647675:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9847a1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.647796:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885543040 00000100:00100000:1.0:1789498316.647805:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885543040 00000100:00100000:1.0:1789498316.647843:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789498316.647851:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885543040:12345-0@lo:502: 00000100:00100000:1.0:1789498316.648284:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885543040:12345-0@lo:502: Request processed in 433us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.648292:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789498316.648460:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885543040:0@lo:502: 00000040:00080000:2.0:1789498316.648558:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789498316.648572:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789498316.649534:0:6722:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789498316.649549:0:6722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98eabb55b380) 00000020:00000080:2.0:1789498316.649569:0:6722:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789498316.649654:0:6722:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98eabd51c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789498316.649659:0:6722:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98eabd51c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789498316.649662:0:6722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eabd51c800 3 00010000:00080000:2.0:1789498316.649697:0:6722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e984c10800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1789498316.651349:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498316.654531:0:6722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789498316.654804:0:6722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789498316.654847:0:6722:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789498316.654871:0:6722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3a6cb1946bc18014 00000100:00080000:2.0:1789498316.654883:0:6722:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498316.654896:0:6722:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98e984c10800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498316.654935:0:6722:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eab9911180 x1876424885543168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498316.654965:0:6722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789498316.655366:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498316.655393:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885543296:0@lo:400: 00000100:00100000:3.0:1789498316.655460:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498316.655523:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885543296 00000100:00100000:3.0:1789498316.655530:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885543296 00000100:00100000:3.0:1789498316.655577:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498316.655587:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885543296:12345-0@lo:400: 00000100:00100000:3.0:1789498316.655643:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885543296:12345-0@lo:400: Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498316.655651:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789498316.655693:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb3e8380 x1876424885543296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498316.655722:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885543296:0@lo:400: 00000100:00100000:1.0:1789498316.656072:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885543168:0@lo:38: 00000100:00100000:1.0:1789498316.656133:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498316.656302:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885543168 00000100:00100000:3.0:1789498316.656308:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885543168 00000100:00100000:3.0:1789498316.656335:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498316.656340:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1876424885543168:12345-0@lo:38: 00010000:00080000:3.0:1789498316.656362:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:3.0:1789498316.656402:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3a6cb1946bc1801b 00000004:00100000:3.0:1789498316.656416:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789498316.656445:0:5846:0:(import.c:65:import_set_state_nolock()) ffff98ea89100000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498316.656486:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876424885543168:12345-0@lo:38: Request processed in 144us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498316.656492:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1789498316.656689:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789498316.657275:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789498316.657299:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789498316.657321:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498316.657333:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789498316.657390:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789498316.657392:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498316.657394:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498316.657395:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498316.657397:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498316.657398:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498316.657400:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498316.657402:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789498316.657403:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789498316.657405:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498316.657406:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498316.657410:0:6699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789498316.657413:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789498316.657415:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498316.657421:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498316.657422:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498316.657423:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498316.657423:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498316.657425:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498316.657426:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789498316.657426:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789498316.657427:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498316.657429:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498316.657449:0:6699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789498316.657463:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885543424:0@lo:253: 00000100:00100000:2.0:1789498316.657520:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498316.657539:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9847a1cc0 going to sleep for 11 seconds 00010000:00080000:1.0:1789498316.657665:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eab9911180 x1876424885543168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498316.657675:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789498316.657683:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789498316.657690:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789498316.657695:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789498316.657698:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e984c10800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789498316.657703:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885543168:0@lo:38: 00000100:00100000:1.0:1789498316.657738:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885543424 00000100:00100000:1.0:1789498316.657742:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885543424 00000100:00100000:1.0:1789498316.657782:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789498316.657790:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6699:x1876424885543424:12345-0@lo:253: 20000000:01000000:1.0:1789498316.657811:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789498316.657824:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789498316.698410:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789498316.698432:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789498316.698486:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789498316.698491:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789498316.698514:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.698533:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc17f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.698542:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.698586:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc17f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498316.698601:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc17f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 13 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498316.698616:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876424885543552:0@lo:104: 00000100:00100000:3.0:1789498316.698698:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498316.698837:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498316.699085:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885543552 00000100:00100000:1.0:1789498316.699189:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885543552 00000100:00100000:1.0:1789498316.699248:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789498316.699257:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5861:x1876424885543552:12345-0@lo:104: 00010000:00010000:1.0:1789498316.699271:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc17f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699326:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789498316.699333:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5861:x1876424885543552:12345-0@lo:104: Request processed in 77us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.699348:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789498316.699403:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498316.699409:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc17f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699417:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80031200 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498316.699421:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc17f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699429:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc17f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498316.699436:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc17f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498316.699443:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789498316.699474:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc17f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699481:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498316.699498:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc17f7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699505:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc17f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699521:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498316.699523:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498316.699524:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498316.699542:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885543680:0@lo:103: 00000100:00100000:1.0:1789498316.699576:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498316.699617:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885543680 00000100:00100000:1.0:1789498316.699621:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885543680 00010000:00010000:1.0:1789498316.699638:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc17f81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 14 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.699662:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789498316.699669:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea851c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:3306:x1876424885543680:12345-0@lo:103: 00010000:00010000:1.0:1789498316.699680:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498316.699685:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc17f81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 14 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699695:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc17f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 14 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699912:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699922:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789498316.699936:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001445283s 00010000:00010000:1.0:1789498316.699940:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699947:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699954:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699970:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699976:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498316.699980:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699988:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.699996:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.700238:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498316.700275:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea851c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:3306:x1876424885543680:12345-0@lo:103: Request processed in 606us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.700281:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789498316.700342:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc17f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17f7a expref: 13 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498316.700353:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876424885543552:0@lo:104: 00010000:00010000:1.0:1789498316.700380:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.700390:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.700397:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498316.700414:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18022 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498316.700999:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885543680:0@lo:103: 00000100:00100000:1.0:1789498316.709219:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:6699:x1876424885543424:12345-0@lo:253: Request processed in 51418us (51686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498316.709234:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789498316.712991:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:6699:1876424885543424:0@lo:253: 10000000:01000000:2.0:1789498316.713084:0:6699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789498316.713105:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789498316.713108:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498316.713177:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498316.713179:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498316.713180:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498316.713182:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498316.713184:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498316.713185:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789498316.713186:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789498316.713188:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498316.713190:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789498316.713207:0:6699:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789498316.720241:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498316.720468:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789498316.720699:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498316.721265:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789498316.721510:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498316.721702:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789498316.723566:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789498316.951842:0:6699:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789498316.951851:0:6699:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789498316.951893:0:6699:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498316.951956:0:6699:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498316.951971:0:6699:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789498316.952000:0:6699:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789498317.681272:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498318.699465:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789498319.659175:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789498319.659181:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98ea90a2f000 from 21 10000000:01000000:1.0:1789498319.659186:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789498319.659236:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.659248:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.659259:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498319.659281:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885543808:0@lo:101: 00000100:00100000:1.0:1789498319.659378:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.659561:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498319.659682:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885543808 00000100:00100000:0.0:1789498319.659692:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885543808 00000100:00100000:0.0:1789498319.661493:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789498319.661514:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885543808:12345-0@lo:101: 00010000:00010000:0.0:1789498319.661533:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498319.661550:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18029 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498319.661577:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498319.661588:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498319.661596:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80031400, rc 0) 00000100:00100000:0.0:1789498319.661684:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885543808:12345-0@lo:101: Request processed in 180us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498319.661691:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789498319.661788:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885543808:0@lo:101: 00010000:00010000:1.0:1789498319.661817:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.661827:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498319.661933:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885543936:0@lo:501: 00000100:00100000:1.0:1789498319.661974:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.666590:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498319.666651:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885543936 00000100:00100000:3.0:1789498319.666662:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885543936 00000100:00100000:3.0:1789498319.666723:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789498319.666732:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885543936:12345-0@lo:501: 00000100:00100000:3.0:1789498319.667211:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885543936:12345-0@lo:501: Request processed in 479us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498319.667219:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789498319.667522:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885543936:0@lo:501: 00000100:00100000:1.0:1789498319.667574:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544064:0@lo:503: 00000100:00100000:1.0:1789498319.667621:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.667691:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498319.667724:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885544064 00000100:00100000:3.0:1789498319.667729:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885544064 00000100:00100000:3.0:1789498319.667827:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789498319.667835:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885544064:12345-0@lo:503: 00000100:00100000:3.0:1789498319.668234:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885544064:12345-0@lo:503: Request processed in 399us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498319.668241:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789498319.668359:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544064:0@lo:503: 00000100:00100000:0.0:1789498319.668673:0:6866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6866:1876424885544192:0@lo:502: 00000100:00100000:0.0:1789498319.668711:0:6866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498319.668785:0:6866:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0fcc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.668865:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885544192 00000100:00100000:1.0:1789498319.668871:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885544192 00000100:00100000:1.0:1789498319.668930:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789498319.668939:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6866:x1876424885544192:12345-0@lo:502: 00000100:00100000:1.0:1789498319.669202:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6866:x1876424885544192:12345-0@lo:502: Request processed in 263us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498319.669209:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789498319.669280:0:6866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6866:1876424885544192:0@lo:502: 00000100:00100000:3.0:1789498319.669337:0:6866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6866:1876424885544320:0@lo:502: 00000100:00100000:3.0:1789498319.669376:0:6866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498319.669501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885544320 00000100:00100000:0.0:1789498319.669506:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885544320 00000100:00100000:0.0:1789498319.669525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789498319.669531:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6866:x1876424885544320:12345-0@lo:502: 00000100:00100000:0.0:1789498319.669656:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:6866:x1876424885544320:12345-0@lo:502: Request processed in 125us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498319.669663:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789498319.669748:0:6866:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498319.669761:0:6866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6866:1876424885544320:0@lo:502: 00000040:00080000:3.0:1789498319.669847:0:6866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789498319.670010:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789498319.670026:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789498319.670035:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.670047:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498319.670058:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789498319.670061:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98ea90a2f000 from 4 10000000:01000000:1.0:1789498319.670070:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789498319.670382:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.670390:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.670400:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498319.670416:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544448:0@lo:101: 00000100:00100000:1.0:1789498319.670448:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.670511:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789498319.670541:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885544448 00000100:00100000:0.0:1789498319.670545:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885544448 00000100:00100000:0.0:1789498319.670602:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789498319.670609:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885544448:12345-0@lo:101: 00010000:00010000:0.0:1789498319.670618:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498319.670629:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18037 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498319.670648:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498319.670658:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498319.670666:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030000, rc 0) 00000100:00100000:0.0:1789498319.670709:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885544448:12345-0@lo:101: Request processed in 101us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498319.670715:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789498319.670767:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544448:0@lo:101: 00010000:00010000:3.0:1789498319.670791:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498319.670800:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498319.670845:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544576:0@lo:256: 00000100:00100000:3.0:1789498319.670875:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498319.671354:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.671393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885544576 00000100:00100000:1.0:1789498319.671398:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885544576 00000100:00100000:1.0:1789498319.671419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789498319.671426:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885544576:12345-0@lo:256: 20000000:01000000:1.0:1789498319.671440:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789498319.671458:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789498319.671461:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789498319.671542:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885544576:12345-0@lo:256: Request processed in 116us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498319.671550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789498319.671582:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544576:0@lo:256: 10000000:01000000:1.0:1789498319.671622:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789498319.671629:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.671637:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498319.671651:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789498319.671653:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789498319.671655:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789498319.671684:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.671692:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.671700:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498319.671714:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544704:0@lo:101: 00000100:00100000:1.0:1789498319.671740:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.671756:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.671767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885544704 00000100:00100000:1.0:1789498319.671819:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885544704 00000100:00100000:1.0:1789498319.671838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789498319.671844:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885544704:12345-0@lo:101: 00010000:00010000:1.0:1789498319.671851:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498319.671860:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18045 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.671876:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.671884:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.671901:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddfc00, rc 0) 00000100:00100000:1.0:1789498319.671930:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885544704:12345-0@lo:101: Request processed in 86us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498319.671936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789498319.671964:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544704:0@lo:101: 00010000:00010000:1.0:1789498319.671975:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.671982:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498319.672020:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544832:0@lo:501: 00000100:00100000:1.0:1789498319.672043:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.672057:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.672068:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885544832 00000100:00100000:1.0:1789498319.672071:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885544832 00000100:00100000:1.0:1789498319.672110:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789498319.672117:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea88529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885544832:12345-0@lo:501: 00000100:00100000:1.0:1789498319.672352:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea88529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885544832:12345-0@lo:501: Request processed in 235us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498319.672359:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789498319.672387:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544832:0@lo:501: 00000100:00100000:1.0:1789498319.672412:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544960:0@lo:503: 00000100:00100000:1.0:1789498319.672447:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.672466:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.672481:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885544960 00000100:00100000:1.0:1789498319.672485:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885544960 00000100:00100000:1.0:1789498319.672500:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789498319.672505:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885544960:12345-0@lo:503: 00000100:00100000:1.0:1789498319.672764:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885544960:12345-0@lo:503: Request processed in 258us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498319.672950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789498319.672989:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885544960:0@lo:503: 00000100:00100000:1.0:1789498319.673153:0:6868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6868:1876424885545088:0@lo:502: 00000100:00100000:1.0:1789498319.673185:0:6868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.673204:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885545088 00000100:00100000:1.0:1789498319.673207:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885545088 00000100:00100000:1.0:1789498319.673225:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789498319.673230:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:6868:x1876424885545088:12345-0@lo:502: 00000100:00100000:1.0:1789498319.673421:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:6868:x1876424885545088:12345-0@lo:502: Request processed in 190us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498319.673428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789498319.673462:0:6868:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.673474:0:6868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6868:1876424885545088:0@lo:502: 00000020:01000000:1.0:1789498319.673495:0:6868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789498319.673503:0:6868:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789498319.673509:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498319.673512:0:6868:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789498319.673520:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789498319.673524:0:6868:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1789498319.673545:0:6868:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789498319.673547:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498319.673565:0:6868:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98ea83f7cd40) 00000020:00000080:1.0:1789498319.673584:0:6868:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789498319.673589:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789498319.673656:0:6868:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789498319.673661:0:6868:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789498319.673668:0:6868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc1805a 00010000:00080000:1.0:1789498319.673698:0:6868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98ea891bf000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1789498319.673936:0:6868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789498319.722609:0:6868:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789498319.722633:0:6868:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00010000:00010000:2.0:1789498319.723539:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498319.724878:0:6868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498319.726572:0:6868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498319.726627:0:6868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789498319.726700:0:6868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789498319.728799:0:6872:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789498319.728807:0:6872:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789498319.730816:0:6868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789498319.730832:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789498319.730867:0:6868:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789498319.730889:0:6868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc18061 00000100:00080000:1.0:1789498319.730908:0:6868:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789498319.730920:0:6868:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98ea891bf000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1789498319.730957:0:6868:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98ea83f72d80 x1876424885545216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498319.730986:0:6868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789498319.731041:0:6868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498319.731046:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498319.731048:0:6868:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789498319.731051:0:6868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498319.731184:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498319.731187:0:6868:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789498319.731192:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789498319.731194:0:6868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789498319.731229:0:6868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6868:1876424885545344:0@lo:502: 00000100:00100000:1.0:1789498319.731448:0:6868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.731501:0:6868:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.731527:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885545344 00000100:00100000:1.0:1789498319.731535:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885545344 00000100:00100000:1.0:1789498319.731573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789498319.731582:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea88528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:6868:x1876424885545344:12345-0@lo:502: 00000100:00100000:1.0:1789498319.731824:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea88528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:6868:x1876424885545344:12345-0@lo:502: Request processed in 242us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498319.731831:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789498319.731884:0:6868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:6868:1876424885545344:0@lo:502: 00000100:00100000:0.0:1789498319.732007:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885545216:0@lo:8: 00000100:00100000:0.0:1789498319.732044:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498319.732138:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885545216 00000100:00100000:3.0:1789498319.732143:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885545216 00000100:00100000:3.0:1789498319.732181:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498319.732186:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885545216:12345-0@lo:8: 00010000:00080000:3.0:1789498319.732209:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:3.0:1789498319.732234:0:6701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc18068 00002000:00100000:3.0:1789498319.732270:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98ea89105000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789498319.732275:0:6701:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789498319.732278:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789498319.732407:0:6701:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789498319.732553:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789498319.732578:0:6701:0:(import.c:65:import_set_state_nolock()) ffff98ea89103800 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1789498319.732587:0:6868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498319.732592:0:6868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498319.732594:0:6868:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789498319.732598:0:6868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1789498319.732628:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876424885545216:12345-0@lo:8: Request processed in 440us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498319.732634:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789498319.732675:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98ea83f72d80 x1876424885545216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498319.732684:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789498319.732691:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789498319.732698:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000020:01000000:1.0:1789498319.732700:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00080000:3.0:1789498319.732703:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789498319.732705:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea891bf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789498319.732715:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000004:00080000:3.0:1789498319.732716:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789498319.732720:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885545216:0@lo:8: 00010000:00010000:1.0:1789498319.732724:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.732735:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498319.732745:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789498319.732748:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98ea83f28000 from 1 10000000:01000000:1.0:1789498319.732751:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789498319.732778:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.732796:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.732805:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498319.732822:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885545472:0@lo:101: 00000100:00100000:1.0:1789498319.732851:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.732880:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789498319.732907:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885545472 00000100:00100000:3.0:1789498319.732911:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885545472 00000100:00100000:3.0:1789498319.732940:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498319.732947:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885545472:12345-0@lo:101: 00010000:00010000:3.0:1789498319.732957:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498319.732971:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1806f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498319.732994:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498319.733004:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498319.733011:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20da800, rc 0) 00000100:00100000:3.0:1789498319.733050:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885545472:12345-0@lo:101: Request processed in 103us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498319.733062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789498319.733183:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885545600:0@lo:400: 00000100:00100000:2.0:1789498319.733217:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498319.733239:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498319.733244:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885545728:0@lo:400: 00000100:00100000:2.0:1789498319.733268:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498319.733329:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885545600 00000100:00100000:2.0:1789498319.733333:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885545600 00000100:00100000:2.0:1789498319.733359:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885545728 00000100:00100000:2.0:1789498319.733362:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885545728 00000100:00100000:2.0:1789498319.733623:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498319.733630:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885545600:12345-0@lo:400: 00000100:00100000:2.0:1789498319.733668:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885545600:12345-0@lo:400: Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498319.733674:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498319.733687:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498319.733693:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885545728:12345-0@lo:400: 00000100:00100000:2.0:1789498319.733719:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885545728:12345-0@lo:400: Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498319.733725:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789498319.733747:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789498319.733769:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eab9913100 x1876424885545728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498319.733780:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885545728:0@lo:400: 00010000:00080000:2.0:1789498319.733791:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eab9911500 x1876424885545600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498319.733799:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885545600:0@lo:400: 00000004:00080000:2.0:1789498319.733833:0:6872:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789498319.734500:0:6872:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 219498408338ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789498319.734665:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885545472:0@lo:101: 00010000:00010000:1.0:1789498319.734686:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498319.734697:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498319.734757:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885545856:0@lo:501: 00000100:00100000:1.0:1789498319.734796:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498319.734832:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.734849:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885545856 00000100:00100000:1.0:1789498319.734853:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885545856 00000100:00100000:1.0:1789498319.734885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789498319.734893:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885545856:12345-0@lo:501: 00000100:00100000:1.0:1789498319.735638:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885545856:12345-0@lo:501: Request processed in 741us (837us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789498319.735647:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789498319.743230:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885545856:0@lo:501: 10000000:01000000:0.0:1789498319.743309:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789498319.743331:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498319.743344:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789498319.808670:0:6873:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789498319.808714:0:6873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6873:1876424885546112:0@lo:7: 00000100:00100000:2.0:1789498319.808795:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885545984:0@lo:13: 00000100:00100000:0.0:1789498319.808798:0:6873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498319.808860:0:6873:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0fcc0c0 going to sleep for 11 seconds 00000004:00080000:0.0:1789498319.808893:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789498319.808898:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498319.808924:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885545984 00000100:00100000:0.0:1789498319.808932:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885545984 00000100:00100000:0.0:1789498319.808995:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498319.809005:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885545984:12345-0@lo:13: 00002000:00000024:0.0:1789498319.809038:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:2.0:1789498319.809124:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498319.809168:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885545984:12345-0@lo:13: Request processed in 164us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498319.809176:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789498319.809915:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e0000 x1876424885545984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498319.809939:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885545984:0@lo:13: 00000100:00100000:1.0:1789498319.810156:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885546112 00000100:00100000:1.0:1789498319.810162:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885546112 00000100:00100000:1.0:1789498319.810199:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498319.810206:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6873:x1876424885546112:12345-0@lo:7: 00002000:00080000:0.0:1789498319.821741:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789498319.821749:0:6704:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789498319.821851:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6873:x1876424885546112:12345-0@lo:7: Request processed in 11641us (13049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498319.821866:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789498319.822110:0:6873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e1880 x1876424885546112/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789498335 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498319.822125:0:6873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6873:1876424885546112:0@lo:7: 00000004:00080000:3.0:1789498319.822138:0:6873:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789498319.822178:0:6873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6873:1876424885546240:0@lo:5: 00000100:00100000:3.0:1789498319.822215:0:6873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498319.822274:0:6873:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498319.822523:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885546240 00000100:00100000:0.0:1789498319.822530:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885546240 00000100:00100000:0.0:1789498319.822585:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498319.822645:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6873:x1876424885546240:12345-0@lo:5: 00002000:00080000:0.0:1789498319.822672:0:6701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789498319.822677:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789498319.822960:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6873:x1876424885546240:12345-0@lo:5: Request processed in 317us (743us total) trans 4294967297 rc 0/0 00010000:00080000:2.0:1789498319.823012:0:6873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb3e8000 x1876424885546240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789498335 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498319.823025:0:6873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6873:1876424885546240:0@lo:5: 00000004:00080000:2.0:1789498319.823044:0:6873:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789498319.823073:0:6873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6873:1876424885546368:0@lo:700: 00000100:00100000:2.0:1789498319.823122:0:6873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498319.823148:0:6873:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9847a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498319.825833:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498319.825912:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885546368 00000100:00100000:0.0:1789498319.825923:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885546368 00000100:00100000:0.0:1789498319.825970:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498319.825992:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6873:x1876424885546368:12345-0@lo:700: 00000100:00100000:0.0:1789498319.826048:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6710:1876424885546496:0@lo:700: 00000100:00100000:0.0:1789498319.826482:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498319.826529:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0fcc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789498319.826616:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885546496 00000100:00100000:1.0:1789498319.826621:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885546496 00000100:00100000:1.0:1789498319.826662:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498319.826669:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6710:x1876424885546496:12345-0@lo:700: 40000000:02000000:0.0:1789498319.875335:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789498319.883142:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6710:x1876424885546496:12345-0@lo:700: Request processed in 56464us (56651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498319.884896:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789498319.885667:0:6710:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e0e00 x1876424885546496/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789498335 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498319.885692:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6710:1876424885546496:0@lo:700: 40000000:02000000:2.0:1789498319.885710:0:6710:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1789498319.974837:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6873:x1876424885546368:12345-0@lo:700: Request processed in 148837us (151704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498319.974855:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789498319.974912:0:6873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eab9913100 x1876424885546368/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789498335 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498319.974945:0:6873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6873:1876424885546368:0@lo:700: 00000001:00080000:3.0:1789498319.977066:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789498319.977137:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1789498320.008481:0:6873:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789498320.013222:0:6873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6873:1876424885546624:0@lo:5: 00000100:00100000:3.0:1789498320.013328:0:6873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498320.013480:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885546624 00000100:00100000:0.0:1789498320.013492:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885546624 00000100:00100000:0.0:1789498320.013565:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498320.013576:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6873:x1876424885546624:12345-0@lo:5: 00000100:00100000:3.0:1789498320.014397:0:6873:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f27300 going to sleep for 11 seconds 00002000:00080000:1.0:1789498320.022053:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789498320.022078:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789498320.027323:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6873:x1876424885546624:12345-0@lo:5: Request processed in 13726us (13971us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789498320.027341:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789498320.027419:0:6873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb3eaa00 x1876424885546624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789498336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498320.027441:0:6873:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789498320.027458:0:6873:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98eabb3eaa00 x1876424885546624/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789498336 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498320.027469:0:6873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6873:1876424885546624:0@lo:5: 00000004:00080000:3.0:1789498320.027483:0:6873:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789498320.755047:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498321.777524:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498322.795525:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498323.819385:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789498324.245537:0:7069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789498324.859208:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498324.971586:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885547008:0@lo:400: 00000100:00100000:0.0:1789498324.971689:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498324.971760:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498324.971767:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885546880:0@lo:400: 00000100:00100000:0.0:1789498324.971801:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498324.971873:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885547008 00000100:00100000:0.0:1789498324.971883:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885547008 00000100:00100000:0.0:1789498324.971942:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789498324.971952:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885547008:12345-0@lo:400: 00000100:00100000:0.0:1789498324.972018:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885547008:12345-0@lo:400: Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498324.972035:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789498324.972064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885546880 00000100:00100000:0.0:1789498324.972068:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885546880 00000100:00100000:0.0:1789498324.972138:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789498324.972146:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3308:x1876424885546880:12345-0@lo:400: 00000100:00100000:0.0:1789498324.972179:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3308:x1876424885546880:12345-0@lo:400: Request processed in 34us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498324.972185:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789498324.972649:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885546880:0@lo:400: 00010000:00080000:0.0:1789498324.972667:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98ea83f70e00 x1876424885547008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498324.972680:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885547008:0@lo:400: 00000100:00100000:3.0:1789498324.975714:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885546752:0@lo:13: 00000100:00100000:3.0:1789498324.975814:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498324.976275:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885546752 00000100:00100000:2.0:1789498324.976288:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885546752 00000100:00100000:2.0:1789498324.976359:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498324.976368:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885546752:12345-0@lo:13: 00002000:00000024:2.0:1789498324.976412:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498324.976636:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885547136:0@lo:400: 00000100:00100000:1.0:1789498324.976680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498324.978021:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885547136 00000100:00100000:1.0:1789498324.978037:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885547136 00000100:00100000:1.0:1789498324.978170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498324.978181:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885547136:12345-0@lo:400: 00000100:00100000:1.0:1789498324.978275:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885547136:12345-0@lo:400: Request processed in 96us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498324.978283:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789498324.978307:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498324.978312:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789498324.978349:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98ea83f71880 x1876424885547136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498324.978366:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885547136:0@lo:400: 00000100:00100000:2.0:1789498324.984062:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885546752:12345-0@lo:13: Request processed in 7680us (8234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498324.984110:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789498324.989808:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eab9913100 x1876424885546752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498324.989848:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885546752:0@lo:13: 00000001:00080000:3.0:1789498325.097685:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789498325.879422:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498326.891232:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498327.917407:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498328.939442:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498329.963295:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498330.095393:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885547264:0@lo:13: 00000100:00100000:3.0:1789498330.095463:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498330.095764:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885547264 00000100:00100000:2.0:1789498330.095774:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885547264 00000100:00100000:2.0:1789498330.095829:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498330.095839:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885547264:12345-0@lo:13: 00002000:00000024:2.0:1789498330.095876:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498330.095927:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885547264:12345-0@lo:13: Request processed in 89us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498330.095934:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789498330.095953:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789498330.095981:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eab9913b80 x1876424885547264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498330.095991:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789498330.096008:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885547264:0@lo:13: 00000100:00100000:0.0:1789498330.096460:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885547392:0@lo:400: 00000100:00100000:0.0:1789498330.096503:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498330.096530:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498330.096536:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885547520:0@lo:400: 00000100:00100000:0.0:1789498330.096560:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498330.096592:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885547520 00000100:00100000:0.0:1789498330.096596:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885547520 00000100:00100000:0.0:1789498330.097794:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498330.097807:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885547520:12345-0@lo:400: 00000100:00100000:2.0:1789498330.097963:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498330.097975:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885547648:0@lo:400: 00000100:00100000:2.0:1789498330.098006:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498330.098047:0:5845:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789498330.098054:0:5845:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789498330.098202:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885547648 00000100:00100000:2.0:1789498330.098209:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885547648 00000100:00100000:2.0:1789498330.098241:0:5845:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789498330.098249:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789498330.098254:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885547648:12345-0@lo:400: 00000100:00100000:2.0:1789498330.098302:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885547648:12345-0@lo:400: Request processed in 48us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498330.098309:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789498330.098327:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789498330.098351:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e3100 x1876424885547648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498330.098363:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885547648:0@lo:400: 00000100:00100000:0.0:1789498330.099347:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885547520:12345-0@lo:400: Request processed in 1538us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498330.099356:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498330.104202:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885547392 00000100:00100000:0.0:1789498330.104232:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885547392 00000100:00100000:0.0:1789498330.104293:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789498330.104303:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3307:x1876424885547392:12345-0@lo:400: 00000100:00100000:0.0:1789498330.104390:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3307:x1876424885547392:12345-0@lo:400: Request processed in 89us (7886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498330.104398:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1789498330.104939:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e1f80 x1876424885547520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498330.104955:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885547520:0@lo:400: 00000100:00100000:3.0:1789498330.104967:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885547392:0@lo:400: 00010000:00010000:3.0:1789498330.987208:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498332.012181:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498333.037802:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498334.064809:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498335.087520:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498335.211397:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885547776:0@lo:400: 00000100:00100000:0.0:1789498335.211510:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498335.211586:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498335.211594:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885548160:0@lo:400: 00000100:00100000:0.0:1789498335.211814:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498335.211852:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885548032:0@lo:400: 00000100:00100000:0.0:1789498335.211886:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498335.211913:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498335.211919:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885547904:0@lo:400: 00000100:00100000:0.0:1789498335.211943:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498335.211985:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885548032 00000100:00100000:0.0:1789498335.211995:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885548032 00000100:00100000:0.0:1789498335.212076:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885547904 00000100:00100000:0.0:1789498335.212080:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885547904 00000100:00100000:0.0:1789498335.212143:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498335.212154:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885548032:12345-0@lo:400: 00000100:00100000:0.0:1789498335.212224:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885548032:12345-0@lo:400: Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498335.212233:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498335.212280:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498335.212285:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885547904:12345-0@lo:400: 00000100:00100000:0.0:1789498335.212319:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885547904:12345-0@lo:400: Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498335.212324:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789498335.212341:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789498335.212384:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e1f80 x1876424885547904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498335.212403:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885547904:0@lo:400: 00010000:00080000:0.0:1789498335.212416:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e3100 x1876424885548032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498335.212424:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885548032:0@lo:400: 00000100:00100000:1.0:1789498335.213204:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885547776 00000100:00100000:1.0:1789498335.213214:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885547776 00000100:00100000:1.0:1789498335.213256:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498335.213264:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3306:x1876424885547776:12345-0@lo:400: 00000100:00100000:1.0:1789498335.213325:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3306:x1876424885547776:12345-0@lo:400: Request processed in 62us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498335.213333:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498335.213374:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885548160 00000100:00100000:1.0:1789498335.213378:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885548160 00000100:00100000:1.0:1789498335.213412:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498335.213418:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885548160:12345-0@lo:400: 00000100:00100000:1.0:1789498335.213454:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885548160:12345-0@lo:400: Request processed in 36us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498335.213460:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789498335.215336:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e0e00 x1876424885548160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498335.215359:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885548160:0@lo:400: 00000100:00100000:1.0:1789498335.215374:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885547776:0@lo:400: 00000100:00080000:1.0:1789498335.215431:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498335.220438:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885548288:0@lo:13: 00000100:00100000:2.0:1789498335.220583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498335.222412:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885548288 00000100:00100000:1.0:1789498335.222431:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885548288 00000100:00100000:1.0:1789498335.222502:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498335.222515:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885548288:12345-0@lo:13: 00002000:00000024:1.0:1789498335.222574:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498335.228513:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885548288:12345-0@lo:13: Request processed in 5985us (7914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498335.228553:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789498335.232405:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eab9910700 x1876424885548288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498335.232446:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885548288:0@lo:13: 00010000:00010000:2.0:1789498336.111001:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498337.137249:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498338.155798:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498339.182880:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789498339.914598:0:7637:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789498339.914604:0:7637:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789498339.914779:0:7637:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98ea891b9000 00000020:01000004:1.0:1789498339.914803:0:7637:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789498339.914820:0:7637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789498339.914850:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98eabadc19c0) 00000020:00000080:1.0:1789498339.914881:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789498340.004928:0:7637:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789498340.016712:0:7637:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789498340.162267:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789498340.178051:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789498340.178112:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789498340.178646:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789498340.178672:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789498340.179994:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789498340.180013:0:7637:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789498340.180029:0:7637:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3a6cb1946bc18084 00000020:01000004:3.0:1789498340.180049:0:7637:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789498340.180078:0:7637:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789498340.180082:0:7637:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789498340.180124:0:7637:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789498340.180170:0:7637:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789498340.180175:0:7637:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1789498340.207817:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789498340.276028:0:7637:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789498340.276157:0:7637:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789498340.276163:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789498340.276166:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789498340.276168:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498340.276169:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498340.276171:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498340.276173:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498340.276176:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498340.276178:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789498340.276180:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789498340.276182:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498340.276184:0:7637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498340.276190:0:7637:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789498340.276193:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789498340.276200:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789498340.276202:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498340.276203:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498340.276204:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498340.276205:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498340.276206:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498340.276207:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789498340.276208:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789498340.276209:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498340.276210:0:7637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498340.276273:0:7637:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789498340.279062:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885548416:0@lo:253: 00000100:00100000:0.0:1789498340.279675:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498340.279757:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498340.282384:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885548416 00000100:00100000:2.0:1789498340.282408:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885548416 00000100:00100000:2.0:1789498340.282509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789498340.282521:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:7637:x1876424885548416:12345-0@lo:253: 20000000:01000000:2.0:1789498340.282586:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789498340.282609:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789498340.282616:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789498340.282620:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789498340.283924:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498340.284257:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789498340.284275:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789498340.284325:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789498340.284335:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789498340.284370:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789498340.284428:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789498340.284876:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789498340.284902:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.120@tcp 20000000:01000000:2.0:1789498340.284904:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789498340.284954:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789498340.284966:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789498340.285038:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789498340.285047:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.120@tcp (null) (null) 00000040:00080000:2.0:1789498340.285084:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789498340.285118:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789498340.285158:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789498340.285216:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789498340.298326:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789498340.298395:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.120@tcp 20000000:01000000:2.0:1789498340.298399:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789498340.300183:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789498340.300216:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789498340.300278:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789498340.300288:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.120@tcp (null) (null) 00000040:00080000:2.0:1789498340.300326:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789498340.300339:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789498340.300426:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789498340.300474:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789498340.300527:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789498340.306290:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789498340.306301:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789498340.306336:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789498340.306341:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789498340.306430:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789498340.306433:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789498340.313833:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789498340.313975:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789498340.314036:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789498340.329220:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789498340.329296:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789498340.329380:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789498340.329401:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789498340.329406:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000100:00100000:1.0:1789498340.331874:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885548672:0@lo:400: 00000100:00100000:1.0:1789498340.331983:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.332061:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498340.332068:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885548544:0@lo:400: 00000100:00100000:1.0:1789498340.332133:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.332165:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885548800:0@lo:400: 00000100:00100000:1.0:1789498340.332199:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.332251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885548672 00000100:00100000:1.0:1789498340.332263:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885548672 00000100:00100000:1.0:1789498340.332339:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885548544 00000100:00100000:1.0:1789498340.332342:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885548544 00000100:00100000:1.0:1789498340.332369:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498340.332383:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885548672:12345-0@lo:400: 00000100:00100000:1.0:1789498340.332466:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885548672:12345-0@lo:400: Request processed in 76us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.332476:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498340.332497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789498340.332503:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885548544:12345-0@lo:400: 00000100:00100000:1.0:1789498340.332548:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885548544:12345-0@lo:400: Request processed in 45us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.332554:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789498340.332593:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885548800 00000100:00100000:1.0:1789498340.332598:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885548800 00000100:00100000:1.0:1789498340.332630:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498340.332636:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885548800:12345-0@lo:400: 00000100:00100000:1.0:1789498340.332671:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885548800:12345-0@lo:400: Request processed in 35us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.332677:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789498340.332694:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498340.332700:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789498340.332742:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98ea83f70000 x1876424885548800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498340.332758:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885548800:0@lo:400: 00010000:00080000:1.0:1789498340.332787:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98ea83f71880 x1876424885548544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498340.332795:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885548544:0@lo:400: 00010000:00080000:1.0:1789498340.332803:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98ea83f70380 x1876424885548672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498340.332810:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885548672:0@lo:400: 20000000:01000000:2.0:1789498340.335275:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789498340.335408:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789498340.335618:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789498340.339026:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789498340.339146:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789498340.339244:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789498340.339261:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789498340.339264:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000100:00100000:1.0:1789498340.339624:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885548928:0@lo:13: 00000100:00100000:1.0:1789498340.339722:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498340.343255:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885548928 00000100:00100000:2.0:1789498340.343279:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885548928 00000100:00100000:2.0:1789498340.343368:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498340.343381:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885548928:12345-0@lo:13: 00002000:00000024:2.0:1789498340.344773:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498340.344914:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885548928:12345-0@lo:13: Request processed in 1533us (5188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498340.344923:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789498340.345170:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb3e8380 x1876424885548928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498340.345201:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885548928:0@lo:13: 00000040:00080000:1.0:1789498340.354930:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789498340.355664:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789498340.355720:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789498340.355816:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789498340.355834:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789498340.355838:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789498340.359960:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789498340.360177:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789498340.360219:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789498340.361003:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789498340.361062:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789498340.361162:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1789498340.361180:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789498340.361183:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789498340.361195:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789498340.361221:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361357:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361365:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361374:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361382:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361389:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361398:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361642:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361663:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 16 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.361683:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549056:0@lo:104: 00000100:00100000:2.0:1789498340.361780:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498340.361837:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361847:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 16 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.361864:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549184:0@lo:104: 00010000:00010000:2.0:1789498340.361893:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361902:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.361911:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549312:0@lo:104: 00010000:00010000:2.0:1789498340.361936:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.361957:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.361966:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549440:0@lo:104: 00010000:00010000:2.0:1789498340.361992:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.362002:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 16 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.362011:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549568:0@lo:104: 00000100:00100000:2.0:1789498340.362030:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9106d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789498340.362214:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789498340.362252:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.362281:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.362291:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.362299:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.362329:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885549056 00000100:00100000:3.0:1789498340.362338:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885549056 00000100:00100000:3.0:1789498340.362385:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885549184 00000100:00100000:3.0:1789498340.362388:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885549184 00000100:00100000:3.0:1789498340.362399:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885549312 00000100:00100000:3.0:1789498340.362401:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885549312 00000100:00100000:3.0:1789498340.362412:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885549440 00000100:00100000:3.0:1789498340.362414:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885549440 00000100:00100000:3.0:1789498340.362443:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885549568 00000100:00100000:3.0:1789498340.362447:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885549568 00000100:00100000:3.0:1789498340.362922:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498340.362936:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+7:5839:x1876424885549056:12345-0@lo:104: 00010000:00010000:3.0:1789498340.362966:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.363056:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789498340.363064:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+7:5839:x1876424885549056:12345-0@lo:104: Request processed in 132us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.363071:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498340.363170:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789498340.363178:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+6:5839:x1876424885549184:12345-0@lo:104: 00010000:00010000:3.0:1789498340.363187:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.363246:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789498340.363252:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+6:5839:x1876424885549184:12345-0@lo:104: Request processed in 75us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.363257:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789498340.363271:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498340.363278:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:5839:x1876424885549312:12345-0@lo:104: 00010000:00010000:3.0:1789498340.363286:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.363313:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789498340.363319:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:5839:x1876424885549312:12345-0@lo:104: Request processed in 42us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.363337:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498340.363350:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498340.363356:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:5839:x1876424885549440:12345-0@lo:104: 00010000:00010000:3.0:1789498340.363364:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.363393:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789498340.363397:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:5839:x1876424885549440:12345-0@lo:104: Request processed in 42us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.363403:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498340.363415:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498340.363421:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5839:x1876424885549568:12345-0@lo:104: 00010000:00010000:3.0:1789498340.363429:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363632:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789498340.363641:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363650:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddec00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498340.363655:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363665:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498340.363672:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498340.363679:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789498340.363724:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363744:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498340.363767:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363774:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc1806f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18076 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363794:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789498340.363797:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363802:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf000 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498340.363805:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363812:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498340.363818:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498340.363823:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789498340.363836:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363842:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498340.363847:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363853:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc18045 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1804c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363869:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498340.363872:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363878:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab640fe00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498340.363880:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363887:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498340.363893:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498340.363898:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789498340.363912:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363919:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498340.363937:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363960:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab640fe00/0x3a6cb1946bc18029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363972:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498340.363975:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.363992:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498340.363996:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.364003:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498340.364010:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498340.364016:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789498340.364030:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.364036:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498340.364042:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.364049:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab6554400/0x3a6cb1946bc17fff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18006 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.364061:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498340.364063:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498340.364065:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498340.364126:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498340.364155:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885550080:0@lo:103: 00000100:00100000:0.0:1789498340.364210:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498340.364259:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498340.364266:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885549952:0@lo:103: 00000100:00100000:0.0:1789498340.364298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.364720:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885549824:0@lo:103: 00000100:00100000:1.0:1789498340.364757:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.364784:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498340.364790:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885549696:0@lo:103: 00000100:00100000:1.0:1789498340.364809:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.364840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885550080 00000100:00100000:1.0:1789498340.364850:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885550080 00010000:00010000:1.0:1789498340.364884:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 17 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498340.364906:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885549952 00000100:00100000:1.0:1789498340.364909:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885549952 00010000:00010000:1.0:1789498340.364920:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 18 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498340.364930:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885549824 00000100:00100000:1.0:1789498340.364932:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885549824 00010000:00010000:1.0:1789498340.364942:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 19 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498340.364966:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885549696 00000100:00100000:1.0:1789498340.364969:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885549696 00010000:00010000:1.0:1789498340.364979:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 20 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498340.364992:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498340.365000:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3306:x1876424885550080:12345-0@lo:103: 00010000:00010000:1.0:1789498340.365017:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498340.365032:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 20 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.365045:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 20 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.365069:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498340.365131:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3306:x1876424885550080:12345-0@lo:103: Request processed in 131us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.365140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498340.365158:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789498340.365164:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885549952:12345-0@lo:103: 00010000:00010000:1.0:1789498340.365172:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498340.365177:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 19 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.365186:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 19 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.365196:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498340.365216:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885549952:12345-0@lo:103: Request processed in 53us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.365223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789498340.365233:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498340.365245:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:3308:x1876424885549824:12345-0@lo:103: 00010000:00010000:1.0:1789498340.365254:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498340.365258:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 18 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.365279:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 18 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.365289:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498340.365317:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:3308:x1876424885549824:12345-0@lo:103: Request processed in 72us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.365323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498340.365335:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789498340.365341:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:3308:x1876424885549696:12345-0@lo:103: 00010000:00010000:1.0:1789498340.365372:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498340.365378:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 17 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.365388:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 17 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.365396:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498340.365418:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:3308:x1876424885549696:12345-0@lo:103: Request processed in 77us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.365424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789498340.365654:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789498340.365664:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5839:x1876424885549568:12345-0@lo:104: Request processed in 2242us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.365673:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789498340.365698:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498340.365704:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.365712:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498340.365717:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.365737:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498340.365744:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498340.365750:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789498340.366396:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac20da800/0x3a6cb1946bc18076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc1806f expref: 16 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.366419:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549056:0@lo:104: 00010000:00010000:2.0:1789498340.366824:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1804c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc18045 expref: 15 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.366835:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549184:0@lo:104: 00010000:00010000:2.0:1789498340.366845:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc18030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc18029 expref: 14 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.366854:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549312:0@lo:104: 00010000:00010000:2.0:1789498340.366862:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc18006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17fff expref: 13 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.366871:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549440:0@lo:104: 00000100:00100000:2.0:1789498340.366880:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876424885549568:0@lo:104: 00010000:00010000:2.0:1789498340.366910:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.367032:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.367041:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498340.367069:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.367076:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc17fd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17fdc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.367115:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498340.367118:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498340.367119:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498340.369313:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885549952:0@lo:103: 00000100:00100000:3.0:1789498340.369332:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885550080:0@lo:103: 00000100:00100000:2.0:1789498340.369741:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885550208:0@lo:103: 00000100:00100000:2.0:1789498340.369835:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.371437:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885550208 00000100:00100000:3.0:1789498340.371468:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885550208 00010000:00010000:3.0:1789498340.371529:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 13 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498340.371580:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498340.371591:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3307:x1876424885550208:12345-0@lo:103: 00010000:00010000:3.0:1789498340.371635:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498340.371642:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 13 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371658:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 13 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371682:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc17fdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17fd5 expref: 13 pid: 5840 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371706:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371717:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371740:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371748:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371755:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371763:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371769:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498340.371774:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371794:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371812:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.371824:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498340.371899:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:3307:x1876424885550208:12345-0@lo:103: Request processed in 310us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.371907:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789498340.372159:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885550208:0@lo:103: 00010000:00010000:2.0:1789498340.372195:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.372204:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.372210:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc1808b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789498340.372239:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789498340.374321:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885549696:0@lo:103: 00000100:00100000:2.0:1789498340.374340:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885549824:0@lo:103: 00000100:00100000:2.0:1789498340.635788:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:7637:x1876424885548416:12345-0@lo:253: Request processed in 353254us (356100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498340.635807:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789498340.636042:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885548416:0@lo:253: 10000000:01000000:0.0:1789498340.636065:0:7637:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789498340.636070:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789498340.636072:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789498340.636074:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498340.636075:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789498340.636077:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498340.636079:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498340.636082:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498340.636084:0:7637:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789498340.636086:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498340.636126:0:7637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789498340.636158:0:7637:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98ea891b9000 from lustre-OST0001 10000000:01000000:0.0:1789498340.636200:0:7637:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789498340.636205:0:7637:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789498340.636216:0:7637:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98ea83f28000 local copy 10000000:01000000:0.0:1789498340.636222:0:7637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789498340.636286:0:7637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.636301:0:7637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.636312:0:7637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498340.636339:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550336:0@lo:101: 00000100:00100000:0.0:1789498340.636398:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498340.636472:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498340.636555:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885550336 00000100:00100000:1.0:1789498340.636567:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885550336 00000100:00100000:1.0:1789498340.636639:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789498340.636651:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+11:7637:x1876424885550336:12345-0@lo:101: 00010000:00010000:1.0:1789498340.636671:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498340.636692:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18092 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.636758:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18092 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.636772:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18092 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.636785:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf400, rc 0) 00000100:00100000:1.0:1789498340.636835:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:7637:x1876424885550336:12345-0@lo:101: Request processed in 186us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.636841:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789498340.637078:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550336:0@lo:101: 00010000:00010000:2.0:1789498340.637131:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.637142:0:7637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.637298:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550464:0@lo:501: 00000100:00100000:2.0:1789498340.637333:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498340.637366:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9106d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498340.637424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885550464 00000100:00100000:3.0:1789498340.637429:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885550464 00000100:00100000:3.0:1789498340.637470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789498340.637478:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:7637:x1876424885550464:12345-0@lo:501: 00000100:00100000:3.0:1789498340.637748:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:7637:x1876424885550464:12345-0@lo:501: Request processed in 270us (414us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498340.637755:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789498340.638359:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550464:0@lo:501: 10000000:01000000:2.0:1789498340.638378:0:7637:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789498340.638418:0:7637:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789498340.638427:0:7637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.638439:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.638464:0:7637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.638491:0:7637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789498340.638517:0:7637:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98ea891b9000 10000000:01000000:2.0:1789498340.638523:0:7637:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789498340.638529:0:7637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789498340.638532:0:7637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789498340.638538:0:7637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789498340.638542:0:7637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789498340.638571:0:7637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.638580:0:7637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.638590:0:7637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.638609:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550592:0@lo:101: 00000100:00100000:2.0:1789498340.638651:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498340.638686:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9847a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789498340.638763:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885550592 00000100:00100000:0.0:1789498340.638769:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885550592 00000100:00100000:0.0:1789498340.638820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789498340.638828:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:7637:x1876424885550592:12345-0@lo:101: 00010000:00010000:0.0:1789498340.638840:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498340.638853:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc180a0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.638878:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.638890:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.638898:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030a00, rc 0) 00000100:00100000:0.0:1789498340.638936:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885550592:12345-0@lo:101: Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498340.638955:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789498340.638992:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550592:0@lo:101: 00010000:00010000:0.0:1789498340.639003:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498340.639012:0:7637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498340.639079:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550720:0@lo:501: 00000100:00100000:0.0:1789498340.639136:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498340.639156:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498340.639168:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885550720 00000100:00100000:0.0:1789498340.639171:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885550720 00000100:00100000:0.0:1789498340.639189:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498340.639202:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885550720:12345-0@lo:501: 00000100:00100000:0.0:1789498340.639438:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885550720:12345-0@lo:501: Request processed in 235us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498340.639446:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498340.639477:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550720:0@lo:501: 00000100:00100000:0.0:1789498340.639504:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550848:0@lo:503: 00000100:00100000:0.0:1789498340.639549:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498340.639564:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498340.639577:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885550848 00000100:00100000:0.0:1789498340.639580:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885550848 00000100:00100000:0.0:1789498340.639597:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498340.639603:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885550848:12345-0@lo:503: 00000100:00100000:0.0:1789498340.639770:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885550848:12345-0@lo:503: Request processed in 166us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498340.639777:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498340.639813:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550848:0@lo:503: 00000040:00080000:0.0:1789498340.640183:0:7637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789498340.640267:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550976:0@lo:502: 00000100:00100000:0.0:1789498340.640307:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498340.640330:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498340.640346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885550976 00000100:00100000:0.0:1789498340.640349:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885550976 00000100:00100000:0.0:1789498340.640369:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789498340.640375:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885550976:12345-0@lo:502: 00000100:00100000:0.0:1789498340.640524:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885550976:12345-0@lo:502: Request processed in 148us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498340.640540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789498340.640583:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885550976:0@lo:502: 00000040:00080000:0.0:1789498340.640862:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789498340.640912:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789498340.640965:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789498340.641013:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789498340.641048:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789498340.641078:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789498340.641138:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551104:0@lo:502: 00000100:00100000:0.0:1789498340.641186:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498340.641214:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498340.641234:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885551104 00000100:00100000:0.0:1789498340.641240:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885551104 00000100:00100000:0.0:1789498340.641263:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789498340.641271:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885551104:12345-0@lo:502: 00000100:00100000:0.0:1789498340.641418:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885551104:12345-0@lo:502: Request processed in 147us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498340.641425:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789498340.641468:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551104:0@lo:502: 00000040:00080000:0.0:1789498340.641549:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789498340.641560:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:1.0:1789498340.642047:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498340.642058:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.642071:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80031600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498340.642076:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.642119:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498340.642129:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498340.642135:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789498340.642167:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.642175:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498340.642212:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.642219:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc18092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3a6cb1946bc18099 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.642235:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498340.642237:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498340.642239:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498340.642254:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885551232:0@lo:103: 00000100:00100000:1.0:1789498340.642303:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.642927:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885551232 00000100:00100000:3.0:1789498340.642936:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885551232 00000100:00100000:3.0:1789498340.643008:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498340.643018:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3308:x1876424885551232:12345-0@lo:103: 00010000:00010000:3.0:1789498340.643033:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498340.643051:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc18092 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.643066:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498340.643149:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:3308:x1876424885551232:12345-0@lo:103: Request processed in 132us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.643166:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498340.643225:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885551232:0@lo:103: 00000020:01000000:2.0:1789498340.643733:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789498340.643744:0:7644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789498340.643752:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498340.643760:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789498340.643768:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498340.643788:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98eabb5599c0) 00000020:00000080:2.0:1789498340.643816:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789498340.643832:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789498340.643903:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98ea891b9000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789498340.643912:0:7644:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789498340.643920:0:7644:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3a6cb1946bc180b5 00010000:00010000:3.0:1789498340.660985:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789498340.661441:0:7644:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789498340.663681:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789498340.679052:0:7644:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789498340.699321:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789498340.699983:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789498340.712615:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789498340.712635:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498340.712645:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498340.712647:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789498340.712651:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498340.712656:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498340.712658:0:7644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789498340.712660:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789498340.712663:0:7644:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789498340.712758:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498340.712761:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498340.712763:0:7644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789498340.712767:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789498340.718650:0:7637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789498340.718706:0:7637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789498340.718744:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.718759:0:7637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498340.718770:0:7637:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea891b9000 from 1 10000000:01000000:3.0:1789498340.718773:0:7637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498340.718831:0:7637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.718840:0:7637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.718853:0:7637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498340.718885:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551360:0@lo:101: 00000100:00100000:3.0:1789498340.718995:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.719078:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498340.723045:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885551360 00000100:00100000:2.0:1789498340.723068:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885551360 00000100:00100000:2.0:1789498340.723179:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789498340.723192:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:7637:x1876424885551360:12345-0@lo:101: 00010000:00010000:2.0:1789498340.723218:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498340.723246:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc180bc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.723288:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.723301:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.723312:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554800, rc 0) 00000100:00100000:2.0:1789498340.723425:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885551360:12345-0@lo:101: Request processed in 237us (4430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.727959:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551360:0@lo:101: 00010000:00010000:3.0:1789498340.728004:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.728021:0:7637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498340.728239:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551488:0@lo:501: 00000100:00100000:3.0:1789498340.728342:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.728401:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498340.728447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885551488 00000100:00100000:3.0:1789498340.728460:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885551488 00000100:00100000:3.0:1789498340.728527:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789498340.728538:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885551488:12345-0@lo:501: 00000100:00100000:3.0:1789498340.728842:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885551488:12345-0@lo:501: Request processed in 304us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.728851:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789498340.728905:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551488:0@lo:501: 00000100:00100000:3.0:1789498340.728950:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551616:0@lo:503: 00000100:00100000:3.0:1789498340.729001:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.729015:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498340.729027:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885551616 00000100:00100000:3.0:1789498340.729031:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885551616 00000100:00100000:3.0:1789498340.729048:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789498340.729054:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885551616:12345-0@lo:503: 00000100:00100000:3.0:1789498340.729413:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885551616:12345-0@lo:503: Request processed in 358us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.729427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789498340.729474:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551616:0@lo:503: 00000040:00080000:3.0:1789498340.729835:0:7637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789498340.729932:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551744:0@lo:502: 00000100:00100000:3.0:1789498340.729986:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.730004:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498340.730021:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885551744 00000100:00100000:3.0:1789498340.730026:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885551744 00000100:00100000:3.0:1789498340.730045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789498340.730051:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885551744:12345-0@lo:502: 00000100:00100000:3.0:1789498340.730266:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885551744:12345-0@lo:502: Request processed in 214us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.730273:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789498340.730313:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551744:0@lo:502: 00000040:00080000:3.0:1789498340.730561:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789498340.730608:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789498340.730629:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551872:0@lo:502: 00000100:00100000:3.0:1789498340.730665:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.730678:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498340.730690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885551872 00000100:00100000:3.0:1789498340.730694:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885551872 00000100:00100000:3.0:1789498340.730709:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789498340.730715:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885551872:12345-0@lo:502: 00000100:00100000:3.0:1789498340.730819:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885551872:12345-0@lo:502: Request processed in 103us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.730825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789498340.730861:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885551872:0@lo:502: 00000040:00080000:3.0:1789498340.730927:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000100:00100000:2.0:1789498340.731160:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000040:00080000:3.0:1789498340.746611:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789498340.748375:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498340.748392:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498340.748395:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789498340.748405:0:7648:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98ea891b9000 00000020:00000080:2.0:1789498340.748407:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498340.748447:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498340.748451:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498340.748453:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789498340.748472:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789498340.757654:0:7637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789498340.757718:0:7637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498340.757750:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.757766:0:7637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498340.757851:0:7637:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789498340.757856:0:7637:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98ea891b9000 10000000:01000000:3.0:1789498340.757860:0:7637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98ea891b9000 10000000:01000000:3.0:1789498340.757865:0:7637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498340.757874:0:7637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98ea891b9000 from 1 10000000:01000000:3.0:1789498340.757877:0:7637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789498340.757945:0:7637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.757956:0:7637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498340.757969:0:7637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498340.757998:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552000:0@lo:101: 00000100:00100000:3.0:1789498340.758340:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498340.758711:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9840 going to sleep for 11 seconds 00000100:00100000:0.0:1789498340.763678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885552000 00000100:00100000:0.0:1789498340.763704:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885552000 00000100:00100000:1.0:1789498340.764199:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789498340.764214:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885552000:12345-0@lo:101: 00010000:00010000:1.0:1789498340.764238:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498340.764279:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc180ca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.764318:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.764355:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.764366:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddea00, rc 0) 00000100:00100000:1.0:1789498340.764787:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552000:12345-0@lo:101: Request processed in 574us (6447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.764794:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789498340.764954:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552000:0@lo:101: 00010000:00010000:2.0:1789498340.764982:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498340.764994:0:7637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498340.765201:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552128:0@lo:501: 00000100:00100000:2.0:1789498340.765244:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498340.765575:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea83efe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498340.765642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885552128 00000100:00100000:1.0:1789498340.765649:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885552128 00000100:00100000:1.0:1789498340.765690:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789498340.765699:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552128:12345-0@lo:501: 00000100:00100000:1.0:1789498340.766036:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552128:12345-0@lo:501: Request processed in 337us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.766045:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789498340.766300:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552128:0@lo:501: 00000100:00100000:0.0:1789498340.766356:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552256:0@lo:503: 00000100:00100000:0.0:1789498340.766411:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498340.766455:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498340.766791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885552256 00000100:00100000:1.0:1789498340.766797:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885552256 00000100:00100000:1.0:1789498340.766837:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789498340.766844:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552256:12345-0@lo:503: 00000100:00100000:1.0:1789498340.767052:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552256:12345-0@lo:503: Request processed in 208us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.767060:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789498340.768831:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552256:0@lo:503: 00000040:00080000:0.0:1789498340.769824:0:7637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789498340.769958:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552384:0@lo:502: 00000100:00100000:0.0:1789498340.770063:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498340.775801:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885552384 00000100:00100000:2.0:1789498340.775824:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885552384 00000100:00100000:2.0:1789498340.775990:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789498340.776004:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552384:12345-0@lo:502: 00000100:00100000:2.0:1789498340.777664:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552384:12345-0@lo:502: Request processed in 1653us (7592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498340.777682:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789498340.777878:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498340.777915:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552384:0@lo:502: 00000040:00080000:1.0:1789498340.778630:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789498340.778706:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789498340.778750:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789498340.778837:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789498340.778883:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789498340.778962:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789498340.778998:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789498340.779034:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789498340.779084:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789498340.779617:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789498340.779657:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789498340.779714:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789498340.779760:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789498340.779823:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789498340.779889:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789498340.779934:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789498340.779991:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789498340.780042:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789498340.780081:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789498340.789268:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789498340.789427:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789498340.789490:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789498340.789532:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789498340.789589:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789498340.789629:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789498340.789665:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789498340.789717:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789498340.789757:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1789498340.789792:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789498340.789846:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1789498340.789886:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1789498340.789922:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1789498340.789975:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1789498340.790025:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1789498340.790063:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1789498340.790148:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1789498340.790201:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1789498340.790278:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552512:0@lo:502: 00000100:00100000:1.0:1789498340.790407:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.792695:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef300 going to sleep for 11 seconds 00000100:00100000:3.0:1789498340.795452:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885552512 00000100:00100000:3.0:1789498340.795503:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885552512 00000100:00100000:3.0:1789498340.795592:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789498340.795605:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552512:12345-0@lo:502: 00000100:00100000:3.0:1789498340.807158:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552512:12345-0@lo:502: Request processed in 11536us (16732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498340.807178:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789498340.808453:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552512:0@lo:502: 00000040:00080000:1.0:1789498340.808678:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789498340.808699:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789498340.812557:0:7649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789498340.812604:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98e9852699c0) 00000020:00000080:2.0:1789498340.812641:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789498340.812757:0:7649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98ea891b9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789498340.812763:0:7649:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98ea891b9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789498340.812767:0:7649:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98ea891b9000 3 00010000:00080000:2.0:1789498340.812812:0:7649:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98ea89107800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1789498340.814835:0:7649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789498340.815153:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789498340.815205:0:7649:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789498340.815229:0:7649:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3a6cb1946bc180df 00000100:00080000:2.0:1789498340.815242:0:7649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498340.815255:0:7649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98ea89107800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498340.815311:0:7649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eab9913480 x1876424885552640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498340.815336:0:7649:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789498340.819629:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885552640:0@lo:38: 00000100:00100000:3.0:1789498340.819763:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.825247:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885552640 00000100:00100000:1.0:1789498340.827490:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885552640 00000100:00100000:1.0:1789498340.827596:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498340.827609:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885552640:12345-0@lo:38: 00010000:00080000:1.0:1789498340.827653:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000040:00080000:0.0:1789498340.828418:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1789498340.828652:0:7651:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff98eabb2e0e00 x1876424885552768/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498340.828668:0:7651:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b090c0 going to sleep for 0 seconds 00000020:00000080:1.0:1789498340.831036:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3a6cb1946bc180e6 00000004:00100000:1.0:1789498340.831067:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789498340.831155:0:5845:0:(import.c:65:import_set_state_nolock()) ffff98eababb8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498340.832214:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876424885552640:12345-0@lo:38: Request processed in 4598us (12443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498340.832233:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:1.0:1789498340.832328:0:7637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789498340.832379:0:7637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789498340.832403:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498340.832417:0:7637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789498340.832513:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789498340.832515:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498340.832522:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498340.832523:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498340.832524:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498340.832525:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498340.832527:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498340.832528:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789498340.832530:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789498340.832532:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498340.832533:0:7637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789498340.832538:0:7637:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789498340.832541:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789498340.832542:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498340.832544:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498340.832545:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498340.832546:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498340.832547:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498340.832548:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498340.832549:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789498340.832549:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789498340.832550:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498340.832551:0:7637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789498340.832581:0:7637:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789498340.832602:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552896:0@lo:253: 00000100:00100000:1.0:1789498340.832668:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498340.832708:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885552896 00000100:00100000:1.0:1789498340.832718:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885552896 00000100:00100000:1.0:1789498340.832767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789498340.832777:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7637:x1876424885552896:12345-0@lo:253: 20000000:01000000:1.0:1789498340.832824:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789498340.832842:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789498340.833474:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef9c0 going to sleep for 11 seconds 00010000:00080000:0.0:1789498340.846238:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eab9913480 x1876424885552640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498340.846260:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789498340.846285:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789498340.846299:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789498340.846307:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789498340.846311:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea89107800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789498340.846322:0:3304:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007c4f54a2): req@ffff98eabb2e0e00 x1876424885552768/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498340.846352:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885552640:0@lo:38: 00000100:00100000:2.0:1789498340.846679:0:7651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498340.846741:0:7651:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498340.849320:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885552768 00000100:00100000:0.0:1789498340.849345:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885552768 00000100:00100000:0.0:1789498340.849447:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498340.849460:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7651:x1876424885552768:12345-0@lo:901: 00000100:00100000:0.0:1789498340.850199:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7651:x1876424885552768:12345-0@lo:901: Request processed in 738us (3516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498340.850210:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789498340.850298:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789498340.850349:0:7651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb2e0e00 x1876424885552768/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789498356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498340.850368:0:7651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7651:1876424885552768:0@lo:901: 20000000:01000000:1.0:1789498341.012966:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789498341.012983:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789498341.013009:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789498341.013015:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789498341.013045:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013142:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013152:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013207:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013226:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 14 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498341.013245:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876424885553024:0@lo:104: 00000100:00100000:1.0:1789498341.013334:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498341.013404:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea845ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789498341.013444:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885553024 00000100:00100000:1.0:1789498341.013455:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885553024 00000100:00100000:1.0:1789498341.013519:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498341.013530:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5861:x1876424885553024:12345-0@lo:104: 00010000:00010000:1.0:1789498341.013546:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013601:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789498341.013608:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:5861:x1876424885553024:12345-0@lo:104: Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498341.013615:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498341.013662:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876424885553024:0@lo:104: 00010000:00010000:1.0:1789498341.013685:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013712:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498341.013719:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013726:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab640fc00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498341.013731:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013740:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498341.013747:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498341.013753:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789498341.013784:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013791:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498341.013813:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013821:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab640fc00/0x3a6cb1946bc18037 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1803e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.013840:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498341.013842:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498341.013843:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498341.013865:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885553152:0@lo:103: 00000100:00100000:1.0:1789498341.013903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498341.013959:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885553152 00000100:00100000:1.0:1789498341.013963:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885553152 00010000:00010000:1.0:1789498341.013983:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 15 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498341.014007:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498341.014014:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea851cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:3305:x1876424885553152:12345-0@lo:103: 00010000:00010000:1.0:1789498341.014025:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498341.014030:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 15 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014042:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 15 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014056:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc1803e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc18037 expref: 15 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014070:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014080:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789498341.014135:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001445283s 00010000:00010000:1.0:1789498341.014140:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014147:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014164:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014170:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014175:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498341.014180:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014187:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014199:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014209:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498341.014238:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea851cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:3305:x1876424885553152:12345-0@lo:103: Request processed in 225us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498341.014245:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789498341.014298:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014306:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498341.014313:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc180ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498341.014340:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885553152:0@lo:103: 00000100:00100000:2.0:1789498341.086667:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:7637:x1876424885552896:12345-0@lo:253: Request processed in 253875us (253981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498341.086686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789498341.087018:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec95aa81-4721-4a06-ac30-039c6a8f6732:7637:1876424885552896:0@lo:253: 10000000:01000000:1.0:1789498341.087039:0:7637:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789498341.087042:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789498341.087044:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498341.087046:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498341.087047:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498341.087048:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498341.087050:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498341.087052:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498341.087054:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789498341.087055:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789498341.087057:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498341.087059:0:7637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789498341.087228:0:7637:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789498341.111870:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498341.113968:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789498341.123770:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498341.124238:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789498341.127629:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498341.127951:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789498341.152567:0:7637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789498341.258959:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789498341.858947:0:7637:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789498341.858962:0:7637:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789498341.859016:0:7637:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498341.859167:0:7637:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498341.859193:0:7637:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789498341.859246:0:7637:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789498342.328342:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498343.339288:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498344.368004:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498345.411553:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498345.453932:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498345.453974:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885553280:0@lo:13: 00000100:00100000:0.0:1789498345.454085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498345.455235:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885553280 00000100:00100000:3.0:1789498345.455254:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885553280 00000100:00100000:3.0:1789498345.455356:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498345.455369:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885553280:12345-0@lo:13: 00002000:00000024:3.0:1789498345.455427:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498345.455538:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885553280:12345-0@lo:13: Request processed in 172us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498345.455546:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789498345.455611:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb3ea300 x1876424885553280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498345.455636:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885553280:0@lo:13: 00000100:00080000:0.0:1789498345.455876:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498345.964002:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885553408:0@lo:400: 00000100:00100000:3.0:1789498345.964150:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498345.964225:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498345.964233:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885553536:0@lo:400: 00000100:00100000:1.0:1789498345.964709:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885553664:0@lo:400: 00000100:00100000:1.0:1789498345.964753:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498345.964858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885553664 00000100:00100000:1.0:1789498345.964869:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885553664 00000100:00100000:1.0:1789498345.964949:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498345.964964:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885553664:12345-0@lo:400: 00000100:00100000:1.0:1789498345.965032:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885553664:12345-0@lo:400: Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498345.965216:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498345.965509:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498345.965559:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885553536 00000100:00100000:3.0:1789498345.965564:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885553536 00000100:00100000:3.0:1789498345.965605:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498345.965611:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885553536:12345-0@lo:400: 00000100:00100000:3.0:1789498345.965653:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885553536:12345-0@lo:400: Request processed in 41us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498345.965659:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789498345.965708:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb2e3b80 x1876424885553536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498345.965726:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885553536:0@lo:400: 00000100:00100000:0.0:1789498345.965890:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885553792:0@lo:400: 00000100:00100000:0.0:1789498345.965965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498345.966027:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885553408 00000100:00100000:0.0:1789498345.966034:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885553408 00000100:00100000:0.0:1789498345.966079:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789498345.966104:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3307:x1876424885553408:12345-0@lo:400: 00000100:00100000:0.0:1789498345.966158:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3307:x1876424885553408:12345-0@lo:400: Request processed in 71us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498345.966164:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789498345.966194:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498345.966542:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885553792 00000100:00100000:3.0:1789498345.966549:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885553792 00000100:00100000:3.0:1789498345.966606:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789498345.966613:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885553792:12345-0@lo:400: 00000100:00100000:3.0:1789498345.966669:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885553792:12345-0@lo:400: Request processed in 57us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498345.966675:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789498345.966711:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885553408:0@lo:400: 00000100:00080000:2.0:1789498345.966916:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789498345.967032:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb2e2680 x1876424885553792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498345.967048:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885553792:0@lo:400: 00010000:00080000:0.0:1789498345.971590:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb2e1f80 x1876424885553664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498345.971621:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885553664:0@lo:400: 00010000:00010000:2.0:1789498346.413451:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498347.437280:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498348.463571:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498349.495142:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789498350.023420:0:7993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1789498350.059278:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789498350.059289:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98eabd51c800 from 30 10000000:01000000:1.0:1789498350.059297:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789498350.059368:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.059411:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.059426:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498350.059460:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885553920:0@lo:101: 00000100:00100000:2.0:1789498350.059665:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498350.059832:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885553920 00000100:00100000:1.0:1789498350.059842:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885553920 00000100:00100000:2.0:1789498350.059900:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498350.060431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789498350.060445:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885553920:12345-0@lo:101: 00010000:00010000:1.0:1789498350.060480:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498350.060501:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc180f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.060553:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.060566:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.060576:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddee00, rc 0) 00000100:00100000:1.0:1789498350.060703:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885553920:12345-0@lo:101: Request processed in 260us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.060713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789498350.061396:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885553920:0@lo:101: 00010000:00010000:2.0:1789498350.061424:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498350.061454:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498350.061566:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554048:0@lo:501: 00000100:00100000:2.0:1789498350.061615:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498350.062054:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6bac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.062232:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885554048 00000100:00100000:0.0:1789498350.062243:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885554048 00000100:00100000:0.0:1789498350.062304:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789498350.062316:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885554048:12345-0@lo:501: 00000100:00100000:0.0:1789498350.062808:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885554048:12345-0@lo:501: Request processed in 492us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.062817:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789498350.066425:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554048:0@lo:501: 00000100:00100000:2.0:1789498350.066517:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554176:0@lo:503: 00000100:00100000:2.0:1789498350.066685:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498350.066743:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498350.067330:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885554176 00000100:00100000:1.0:1789498350.067341:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885554176 00000100:00100000:1.0:1789498350.067405:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789498350.067430:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885554176:12345-0@lo:503: 00000100:00100000:1.0:1789498350.067895:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885554176:12345-0@lo:503: Request processed in 466us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.067904:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789498350.068142:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554176:0@lo:503: 00000100:00100000:0.0:1789498350.068592:0:7995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7995:1876424885554304:0@lo:502: 00000100:00100000:0.0:1789498350.068646:0:7995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.068685:0:7995:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498350.068727:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885554304 00000100:00100000:1.0:1789498350.068733:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885554304 00000100:00100000:1.0:1789498350.068776:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789498350.068784:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7995:x1876424885554304:12345-0@lo:502: 00000100:00100000:1.0:1789498350.069119:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7995:x1876424885554304:12345-0@lo:502: Request processed in 306us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.069127:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789498350.069313:0:7995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7995:1876424885554304:0@lo:502: 00000100:00100000:2.0:1789498350.069367:0:7995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7995:1876424885554432:0@lo:502: 00000100:00100000:2.0:1789498350.069402:0:7995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498350.069435:0:7995:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6bac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.069493:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885554432 00000100:00100000:0.0:1789498350.069499:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885554432 00000100:00100000:0.0:1789498350.069536:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789498350.069544:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7995:x1876424885554432:12345-0@lo:502: 00000100:00100000:0.0:1789498350.069710:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:7995:x1876424885554432:12345-0@lo:502: Request processed in 166us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.069716:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789498350.069806:0:7995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7995:1876424885554432:0@lo:502: 00000040:00080000:2.0:1789498350.069826:0:7995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789498350.070029:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789498350.070055:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789498350.070067:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.070120:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498350.070133:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789498350.070136:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789498350.070139:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789498350.070171:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.070179:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.070189:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498350.070203:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554560:0@lo:101: 00000100:00100000:0.0:1789498350.070234:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.070254:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498350.070332:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885554560 00000100:00100000:1.0:1789498350.070336:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885554560 00000100:00100000:1.0:1789498350.070361:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789498350.070369:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885554560:12345-0@lo:101: 00010000:00010000:1.0:1789498350.070379:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498350.070394:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18102 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.070420:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.070431:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.070441:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf200, rc 0) 00000100:00100000:1.0:1789498350.070477:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885554560:12345-0@lo:101: Request processed in 110us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.070493:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789498350.070565:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554560:0@lo:101: 00010000:00010000:0.0:1789498350.070579:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.070588:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498350.070631:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554688:0@lo:501: 00000100:00100000:0.0:1789498350.070655:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.070687:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.070698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885554688 00000100:00100000:0.0:1789498350.070701:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885554688 00000100:00100000:0.0:1789498350.070717:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789498350.070723:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885554688:12345-0@lo:501: 00000100:00100000:0.0:1789498350.070979:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885554688:12345-0@lo:501: Request processed in 255us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.070985:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789498350.071013:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554688:0@lo:501: 00000100:00100000:0.0:1789498350.071038:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554816:0@lo:503: 00000100:00100000:0.0:1789498350.071072:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.071085:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.071125:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885554816 00000100:00100000:0.0:1789498350.071128:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885554816 00000100:00100000:0.0:1789498350.071145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789498350.071150:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885554816:12345-0@lo:503: 00000100:00100000:0.0:1789498350.071467:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885554816:12345-0@lo:503: Request processed in 316us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.071474:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789498350.071512:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885554816:0@lo:503: 00000100:00100000:0.0:1789498350.071743:0:7996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7996:1876424885554944:0@lo:502: 00000100:00100000:0.0:1789498350.071798:0:7996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.071819:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885554944 00000100:00100000:0.0:1789498350.071823:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885554944 00000100:00100000:0.0:1789498350.071841:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789498350.071848:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:7996:x1876424885554944:12345-0@lo:502: 00000100:00100000:0.0:1789498350.072030:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:7996:x1876424885554944:12345-0@lo:502: Request processed in 181us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.072037:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789498350.072067:0:7996:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.072081:0:7996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7996:1876424885554944:0@lo:502: 00000020:01000000:0.0:1789498350.072132:0:7996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498350.072145:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498350.072148:0:7996:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789498350.072154:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789498350.072157:0:7996:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789498350.072172:0:7996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7996:1876424885555072:0@lo:502: 00000100:00100000:0.0:1789498350.072205:0:7996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.072225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885555072 00000100:00100000:0.0:1789498350.072229:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885555072 00000100:00100000:0.0:1789498350.072247:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789498350.072253:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:7996:x1876424885555072:12345-0@lo:502: 00000100:00100000:0.0:1789498350.072370:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:7996:x1876424885555072:12345-0@lo:502: Request processed in 116us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.072376:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789498350.072402:0:7996:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.072415:0:7996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7996:1876424885555072:0@lo:502: 00000020:01000000:0.0:1789498350.072432:0:7996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498350.072436:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498350.072438:0:7996:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789498350.072442:0:7996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789498350.072522:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789498350.072543:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789498350.072556:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.072577:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498350.072592:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789498350.072596:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98ea90a2f000 from 30 10000000:01000000:0.0:1789498350.072599:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789498350.072634:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.072644:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.072655:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498350.072668:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555200:0@lo:101: 00000100:00100000:0.0:1789498350.072697:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.072710:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.072725:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885555200 00000100:00100000:0.0:1789498350.072729:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885555200 00000100:00100000:0.0:1789498350.072747:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789498350.072753:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885555200:12345-0@lo:101: 00010000:00010000:0.0:1789498350.072764:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498350.072797:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18110 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.072823:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.072846:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.072856:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030200, rc 0) 00000100:00100000:0.0:1789498350.072887:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885555200:12345-0@lo:101: Request processed in 134us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.072893:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789498350.072922:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555200:0@lo:101: 00010000:00010000:0.0:1789498350.072935:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.072944:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498350.072986:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555328:0@lo:501: 00000100:00100000:0.0:1789498350.073011:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.073023:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.073034:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885555328 00000100:00100000:0.0:1789498350.073037:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885555328 00000100:00100000:0.0:1789498350.073052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789498350.073057:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885555328:12345-0@lo:501: 00000100:00100000:0.0:1789498350.073310:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885555328:12345-0@lo:501: Request processed in 252us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.073318:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789498350.073350:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555328:0@lo:501: 00000100:00100000:0.0:1789498350.073379:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555456:0@lo:503: 00000100:00100000:0.0:1789498350.073422:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.073436:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea981fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.073448:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885555456 00000100:00100000:0.0:1789498350.073451:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885555456 00000100:00100000:0.0:1789498350.073467:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789498350.073471:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885555456:12345-0@lo:503: 00000100:00100000:0.0:1789498350.073637:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885555456:12345-0@lo:503: Request processed in 164us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.073644:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789498350.073681:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555456:0@lo:503: 00000100:00100000:0.0:1789498350.075438:0:7997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7997:1876424885555584:0@lo:502: 00000100:00100000:0.0:1789498350.075538:0:7997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.075635:0:7997:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea981fa780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498350.075693:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885555584 00000100:00100000:1.0:1789498350.075704:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885555584 00000100:00100000:1.0:1789498350.075809:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789498350.075821:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:7997:x1876424885555584:12345-0@lo:502: 00000100:00100000:1.0:1789498350.076284:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:7997:x1876424885555584:12345-0@lo:502: Request processed in 464us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.076293:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789498350.076426:0:7997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7997:1876424885555584:0@lo:502: 00000100:00100000:0.0:1789498350.076489:0:7997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7997:1876424885555712:0@lo:502: 00000100:00100000:0.0:1789498350.076529:0:7997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.076592:0:7997:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea981fa780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498350.076631:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885555712 00000100:00100000:1.0:1789498350.076635:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885555712 00000100:00100000:1.0:1789498350.076669:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789498350.076676:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:7997:x1876424885555712:12345-0@lo:502: 00000100:00100000:1.0:1789498350.076824:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:7997:x1876424885555712:12345-0@lo:502: Request processed in 148us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.076830:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789498350.076925:0:7997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7997:1876424885555712:0@lo:502: 00000040:00080000:0.0:1789498350.076943:0:7997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789498350.077155:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789498350.077176:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789498350.077188:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.077201:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498350.077214:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789498350.077218:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98ea90a2f000 from 5 10000000:01000000:1.0:1789498350.077221:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789498350.077256:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.077276:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.077287:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498350.077302:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555840:0@lo:101: 00000100:00100000:1.0:1789498350.077338:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498350.077359:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.077402:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885555840 00000100:00100000:0.0:1789498350.077408:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885555840 00000100:00100000:0.0:1789498350.077437:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789498350.077444:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885555840:12345-0@lo:101: 00010000:00010000:0.0:1789498350.077455:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498350.077471:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80030400/0x3a6cb1946bc18125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1811e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.077504:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80030400/0x3a6cb1946bc18125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1811e expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.077516:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80030400/0x3a6cb1946bc18125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1811e expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.077526:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030400, rc 0) 00000100:00100000:0.0:1789498350.077558:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885555840:12345-0@lo:101: Request processed in 115us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.077565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789498350.077632:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555840:0@lo:101: 00010000:00010000:1.0:1789498350.077645:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498350.077655:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498350.077701:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555968:0@lo:256: 00000100:00100000:1.0:1789498350.077732:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498350.077795:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.077843:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885555968 00000100:00100000:0.0:1789498350.077847:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885555968 00000100:00100000:0.0:1789498350.077879:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789498350.077885:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885555968:12345-0@lo:256: 20000000:01000000:0.0:1789498350.077900:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789498350.077923:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789498350.077927:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789498350.078018:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885555968:12345-0@lo:256: Request processed in 132us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.078026:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789498350.078058:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885555968:0@lo:256: 10000000:01000000:0.0:1789498350.078156:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789498350.078162:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.078170:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498350.078189:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789498350.078192:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789498350.078195:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789498350.078218:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.078226:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.078233:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498350.078249:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885556096:0@lo:101: 00000100:00100000:0.0:1789498350.078278:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.078291:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.078307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885556096 00000100:00100000:0.0:1789498350.078312:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885556096 00000100:00100000:0.0:1789498350.078334:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789498350.078340:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885556096:12345-0@lo:101: 00010000:00010000:0.0:1789498350.078349:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498350.078360:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1812c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.078379:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.078389:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.078410:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80031e00, rc 0) 00000100:00100000:0.0:1789498350.078446:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885556096:12345-0@lo:101: Request processed in 105us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.078453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789498350.078503:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885556096:0@lo:101: 00010000:00010000:0.0:1789498350.078522:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.078530:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498350.078582:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885556224:0@lo:501: 00000100:00100000:0.0:1789498350.078608:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.078622:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.078634:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885556224 00000100:00100000:0.0:1789498350.078637:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885556224 00000100:00100000:0.0:1789498350.078654:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789498350.078659:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885556224:12345-0@lo:501: 00000100:00100000:0.0:1789498350.078977:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885556224:12345-0@lo:501: Request processed in 316us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.078984:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789498350.079018:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885556224:0@lo:501: 00000100:00100000:0.0:1789498350.079048:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885556352:0@lo:503: 00000100:00100000:0.0:1789498350.079086:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.079128:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.079147:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885556352 00000100:00100000:0.0:1789498350.079150:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885556352 00000100:00100000:0.0:1789498350.079167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789498350.079172:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885556352:12345-0@lo:503: 00000100:00100000:0.0:1789498350.079507:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885556352:12345-0@lo:503: Request processed in 334us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.079514:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789498350.079553:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885556352:0@lo:503: 00000100:00100000:0.0:1789498350.079784:0:7998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7998:1876424885556480:0@lo:502: 00000100:00100000:0.0:1789498350.079823:0:7998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.079843:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885556480 00000100:00100000:0.0:1789498350.079847:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885556480 00000100:00100000:0.0:1789498350.079865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789498350.079871:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:7998:x1876424885556480:12345-0@lo:502: 00000100:00100000:0.0:1789498350.080126:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:7998:x1876424885556480:12345-0@lo:502: Request processed in 254us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498350.080133:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789498350.080163:0:7998:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f27180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.080180:0:7998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7998:1876424885556480:0@lo:502: 00000020:01000000:0.0:1789498350.080204:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789498350.080214:0:7998:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789498350.080222:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498350.080224:0:7998:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789498350.080231:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789498350.080235:0:7998:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:0.0:1789498350.080265:0:7998:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789498350.080268:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789498350.080304:0:7998:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98e98443cd40) 00000020:00000080:0.0:1789498350.080334:0:7998:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789498350.080340:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789498350.080424:0:7998:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789498350.080431:0:7998:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789498350.080450:0:7998:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc18141 00010000:00080000:0.0:1789498350.080487:0:7998:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e987723000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1789498350.080764:0:7998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789498350.081620:0:7998:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789498350.081638:0:7998:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789498350.082305:0:7998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789498350.082546:0:7998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789498350.082612:0:7998:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789498350.082686:0:7998:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789498350.083261:0:7999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789498350.083268:0:7999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789498350.087903:0:7998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789498350.087923:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789498350.087985:0:7998:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789498350.088018:0:7998:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc18148 00000100:00080000:1.0:1789498350.088032:0:7998:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789498350.088048:0:7998:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e987723000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1789498350.088151:0:7998:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98ea83f70000 x1876424885556608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498350.088185:0:7998:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789498350.088355:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885556608:0@lo:8: 00000100:00100000:2.0:1789498350.088447:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498350.088523:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885556608 00000100:00100000:2.0:1789498350.088532:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885556608 00000100:00100000:2.0:1789498350.088572:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498350.088581:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885556608:12345-0@lo:8: 00010000:00080000:2.0:1789498350.088625:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1789498350.088660:0:6701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc1814f 00002000:00100000:2.0:1789498350.088677:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98ea891b8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789498350.088682:0:6701:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789498350.088688:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789498350.088899:0:6701:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789498350.089176:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789498350.089215:0:6701:0:(import.c:65:import_set_state_nolock()) ffff98ea891ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498350.089299:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876424885556608:12345-0@lo:8: Request processed in 716us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498350.089308:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789498350.089373:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea83f70000 x1876424885556608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498350.089386:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789498350.089398:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789498350.089409:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789498350.089416:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789498350.089420:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e987723000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789498350.089441:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789498350.089446:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885556608:0@lo:8: 00000004:00080000:2.0:1789498350.091302:0:7999:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789498350.091525:0:7999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 249855433779ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789498350.100567:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885556736:0@lo:400: 00000100:00100000:1.0:1789498350.100672:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498350.100733:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498350.100739:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885556864:0@lo:400: 00000100:00100000:1.0:1789498350.100765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498350.100817:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885556992:0@lo:400: 00000100:00100000:1.0:1789498350.100846:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498350.100866:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498350.100870:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885557120:0@lo:400: 00000100:00100000:1.0:1789498350.100896:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498350.100928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885556736 00000100:00100000:1.0:1789498350.100938:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885556736 00000100:00100000:1.0:1789498350.100987:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885556864 00000100:00100000:1.0:1789498350.100990:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885556864 00000100:00100000:1.0:1789498350.101009:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885557120 00000100:00100000:1.0:1789498350.101011:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885557120 00000100:00100000:1.0:1789498350.101025:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789498350.101033:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885556736:12345-0@lo:400: 00000100:00100000:1.0:1789498350.101118:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885556736:12345-0@lo:400: Request processed in 85us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.101126:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789498350.101144:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789498350.101149:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885556864:12345-0@lo:400: 00000100:00100000:1.0:1789498350.101174:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885556864:12345-0@lo:400: Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.101196:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789498350.101206:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789498350.101211:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885557120:12345-0@lo:400: 00000100:00100000:1.0:1789498350.101237:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885557120:12345-0@lo:400: Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.101242:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789498350.101264:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885556992 00000100:00100000:1.0:1789498350.101268:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885556992 00000100:00100000:1.0:1789498350.101300:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498350.101307:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885556992:12345-0@lo:400: 00000100:00100000:1.0:1789498350.101338:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885556992:12345-0@lo:400: Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.101343:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789498350.101365:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498350.101371:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789498350.101401:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea83f72680 x1876424885556864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498350.101418:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885556864:0@lo:400: 00010000:00080000:1.0:1789498350.101430:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea83f73800 x1876424885556736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498350.101439:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885556736:0@lo:400: 00010000:00080000:1.0:1789498350.101469:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea83f73480 x1876424885557120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498350.101476:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885557120:0@lo:400: 00010000:00080000:1.0:1789498350.101484:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea83f70700 x1876424885556992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498350.101497:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885556992:0@lo:400: 00000020:01000000:1.0:1789498350.103648:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498350.103661:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498350.103664:0:7998:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789498350.103668:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498350.103674:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498350.103675:0:7998:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789498350.103679:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789498350.103681:0:7998:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789498350.103744:0:7998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7998:1876424885557248:0@lo:502: 00000100:00100000:1.0:1789498350.103943:0:7998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498350.103998:0:7998:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498350.106902:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885557248 00000100:00100000:1.0:1789498350.106928:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885557248 00000100:00100000:1.0:1789498350.107017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789498350.107030:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:7998:x1876424885557248:12345-0@lo:502: 00000100:00100000:1.0:1789498350.107482:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:7998:x1876424885557248:12345-0@lo:502: Request processed in 454us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.107492:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789498350.107584:0:7998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:7998:1876424885557248:0@lo:502: 00000020:01000000:1.0:1789498350.107630:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498350.107640:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498350.107643:0:7998:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789498350.107648:0:7998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789498350.108264:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789498350.108290:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789498350.108305:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.108321:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498350.108336:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789498350.108340:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98ea83f28000 from 1 10000000:01000000:0.0:1789498350.108344:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789498350.108390:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.108400:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.108412:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498350.108449:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885557376:0@lo:101: 00000100:00100000:0.0:1789498350.108501:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.108552:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea93b6e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498350.109517:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885557376 00000100:00100000:2.0:1789498350.109531:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885557376 00000100:00100000:2.0:1789498350.109604:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789498350.109616:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885557376:12345-0@lo:101: 00010000:00010000:2.0:1789498350.109649:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498350.109669:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18156 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498350.109702:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498350.109716:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498350.109727:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554c00, rc 0) 00000100:00100000:2.0:1789498350.109832:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885557376:12345-0@lo:101: Request processed in 219us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498350.109840:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789498350.113207:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885557376:0@lo:101: 00010000:00010000:0.0:1789498350.113258:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.113275:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498350.113396:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885557504:0@lo:501: 00000100:00100000:0.0:1789498350.113480:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498350.113527:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea93b6e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789498350.113573:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885557504 00000100:00100000:0.0:1789498350.113580:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885557504 00000100:00100000:0.0:1789498350.113635:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789498350.113645:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885557504:12345-0@lo:501: 00000100:00100000:0.0:1789498350.113938:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885557504:12345-0@lo:501: Request processed in 294us (457us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789498350.113947:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789498350.113990:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885557504:0@lo:501: 10000000:01000000:0.0:1789498350.114021:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789498350.114029:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498350.114039:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789498350.218639:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789498350.218865:0:8000:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789498350.218900:0:8000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1876424885557760:0@lo:7: 00000100:00100000:3.0:1789498350.219004:0:8000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498350.219066:0:8000:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498350.219147:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885557760 00000100:00100000:3.0:1789498350.219155:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885557760 00000100:00100000:3.0:1789498350.219212:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498350.219221:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8000:x1876424885557760:12345-0@lo:7: 00000100:00100000:1.0:1789498350.222651:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885557632:0@lo:13: 00000100:00100000:1.0:1789498350.222741:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789498350.222865:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498350.222888:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885557632 00000100:00100000:1.0:1789498350.222896:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885557632 00000100:00100000:1.0:1789498350.223159:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498350.223171:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876424885557632:12345-0@lo:13: 00002000:00000024:1.0:1789498350.223210:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789498350.223405:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876424885557632:12345-0@lo:13: Request processed in 236us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498350.223414:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789498350.223473:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb3eb800 x1876424885557632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498350.223495:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885557632:0@lo:13: 00002000:00080000:3.0:1789498350.236881:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789498350.236894:0:6702:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789498350.237252:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8000:x1876424885557760:12345-0@lo:7: Request processed in 18026us (18243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498350.237274:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789498350.237503:0:8000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb3e9500 x1876424885557760/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789498366 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498350.237520:0:8000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1876424885557760:0@lo:7: 00000004:00080000:2.0:1789498350.237537:0:8000:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789498350.237651:0:8000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1876424885557888:0@lo:5: 00000100:00100000:2.0:1789498350.237690:0:8000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498350.237798:0:8000:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba540 going to sleep for 11 seconds 00000100:00100000:1.0:1789498350.238414:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885557888 00000100:00100000:1.0:1789498350.238423:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885557888 00000100:00100000:1.0:1789498350.238513:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498350.238523:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8000:x1876424885557888:12345-0@lo:5: 00002000:00080000:1.0:1789498350.238551:0:6701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789498350.238556:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789498350.238981:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8000:x1876424885557888:12345-0@lo:5: Request processed in 458us (1288us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789498350.239120:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789498350.239536:0:8000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9911f80 x1876424885557888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789498366 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498350.239552:0:8000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1876424885557888:0@lo:5: 00000004:00080000:3.0:1789498350.239573:0:8000:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789498350.239612:0:8000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1876424885558016:0@lo:700: 00000100:00100000:3.0:1789498350.239651:0:8000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498350.239682:0:8000:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498350.239836:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885558016 00000100:00100000:2.0:1789498350.239843:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885558016 00000100:00100000:2.0:1789498350.239880:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498350.239888:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8000:x1876424885558016:12345-0@lo:700: 00000100:00100000:2.0:1789498350.239921:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9912a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6710:1876424885558144:0@lo:700: 00000100:00100000:2.0:1789498350.239965:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498350.240015:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498350.240039:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885558144 00000100:00100000:2.0:1789498350.240042:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885558144 00000100:00100000:2.0:1789498350.240070:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498350.240076:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6710:x1876424885558144:12345-0@lo:700: 40000000:02000000:3.0:1789498350.280149:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789498350.293600:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6710:x1876424885558144:12345-0@lo:700: Request processed in 53512us (53622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498350.293615:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789498350.295651:0:6710:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9912a00 x1876424885558144/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789498366 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498350.295670:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9912a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6710:1876424885558144:0@lo:700: 40000000:02000000:2.0:1789498350.295682:0:6710:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1789498350.497928:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8000:x1876424885558016:12345-0@lo:700: Request processed in 258032us (258267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498350.497943:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:2.0:1789498350.497982:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1789498350.498004:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1789498350.498050:0:8000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb3e9500 x1876424885558016/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789498366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498350.498068:0:8000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1876424885558016:0@lo:700: 00010000:00010000:3.0:1789498350.510397:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498350.575555:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885558272:0@lo:13: 00000100:00100000:2.0:1789498350.575698:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498350.575795:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885558272 00000100:00100000:3.0:1789498350.575804:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885558272 00000100:00100000:3.0:1789498350.575851:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789498350.575861:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885558272:12345-0@lo:13: 00002000:00000024:3.0:1789498350.575898:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498350.576086:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885558272:12345-0@lo:13: Request processed in 225us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498350.576121:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789498350.580318:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb2e2680 x1876424885558272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498350.580349:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885558272:0@lo:13: 00000004:02000040:3.0:1789498350.632008:0:8000:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789498350.636703:0:8000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1876424885558400:0@lo:5: 00000100:00100000:3.0:1789498350.636786:0:8000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498350.636920:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885558400 00000100:00100000:2.0:1789498350.636929:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885558400 00000100:00100000:2.0:1789498350.636989:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498350.636998:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8000:x1876424885558400:12345-0@lo:5: 00000100:00100000:3.0:1789498350.637742:0:8000:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea8660dc00 going to sleep for 11 seconds 00002000:00080000:3.0:1789498350.644452:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789498350.644548:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789498350.648994:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8000:x1876424885558400:12345-0@lo:5: Request processed in 11985us (12197us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789498350.649009:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789498350.649721:0:8000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb3eb100 x1876424885558400/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789498366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498350.649736:0:8000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789498350.649751:0:8000:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98eabb3eb100 x1876424885558400/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789498366 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498350.649775:0:8000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1876424885558400:0@lo:5: 00000004:00080000:2.0:1789498350.649791:0:8000:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789498351.533208:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498352.555258:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498353.579655:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498354.603281:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498355.181204:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885558528:0@lo:400: 00000100:00100000:2.0:1789498355.181382:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498355.181432:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885559040:0@lo:400: 00000100:00100000:2.0:1789498355.181460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498355.181488:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789498355.181495:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885558656:0@lo:400: 00000100:00100000:2.0:1789498355.181534:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498355.181556:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885559168:0@lo:400: 00000100:00100000:2.0:1789498355.181582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498355.181615:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885558784:0@lo:400: 00000100:00100000:2.0:1789498355.181639:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498355.181658:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498355.181663:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885558912:0@lo:400: 00000100:00100000:2.0:1789498355.181697:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498355.181731:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885558528 00000100:00100000:2.0:1789498355.181739:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885558528 00000100:00100000:2.0:1789498355.181793:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789498355.181801:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885558528:12345-0@lo:400: 00000100:00100000:2.0:1789498355.181853:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885558528:12345-0@lo:400: Request processed in 52us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498355.181861:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789498355.181896:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885559040 00000100:00100000:2.0:1789498355.181900:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885559040 00000100:00100000:2.0:1789498355.181937:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885558656 00000100:00100000:2.0:1789498355.181940:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885558656 00000100:00100000:2.0:1789498355.181951:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885558784 00000100:00100000:2.0:1789498355.181954:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885558784 00000100:00100000:2.0:1789498355.181968:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498355.181974:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885559040:12345-0@lo:400: 00000100:00100000:2.0:1789498355.182006:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885559040:12345-0@lo:400: Request processed in 32us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498355.182012:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498355.182023:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498355.182028:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885558656:12345-0@lo:400: 00000100:00100000:2.0:1789498355.182055:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885558656:12345-0@lo:400: Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498355.182061:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498355.182073:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498355.182078:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885558784:12345-0@lo:400: 00000100:00100000:2.0:1789498355.182131:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885558784:12345-0@lo:400: Request processed in 53us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498355.182136:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498355.182158:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885559168 00000100:00100000:2.0:1789498355.182168:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885559168 00000100:00100000:2.0:1789498355.182198:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885558912 00000100:00100000:2.0:1789498355.182200:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885558912 00000100:00100000:2.0:1789498355.182214:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498355.182219:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885559168:12345-0@lo:400: 00000100:00100000:2.0:1789498355.182391:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885559168:12345-0@lo:400: Request processed in 171us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498355.182398:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498355.182412:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498355.182418:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885558912:12345-0@lo:400: 00000100:00100000:2.0:1789498355.182447:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885558912:12345-0@lo:400: Request processed in 29us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498355.182452:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789498355.182480:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498355.182484:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498355.182487:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789498355.182524:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9910e00 x1876424885558912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498355.182538:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885558912:0@lo:400: 00010000:00080000:2.0:1789498355.182551:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9911c00 x1876424885558784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498355.182558:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885558784:0@lo:400: 00010000:00080000:2.0:1789498355.182592:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9910000 x1876424885558656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498355.182600:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885558656:0@lo:400: 00010000:00080000:2.0:1789498355.182608:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9910a80 x1876424885559168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498355.182627:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885559168:0@lo:400: 00000100:00100000:2.0:1789498355.182638:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885558528:0@lo:400: 00010000:00080000:2.0:1789498355.182648:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9913480 x1876424885559040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498355.182654:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885559040:0@lo:400: 00000001:00080000:2.0:1789498355.238875:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1789498355.627246:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498355.691704:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885559296:0@lo:13: 00000100:00100000:1.0:1789498355.691779:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498355.692247:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885559296 00000100:00100000:0.0:1789498355.692256:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885559296 00000100:00100000:0.0:1789498355.692299:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498355.692308:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885559296:12345-0@lo:13: 00002000:00000024:0.0:1789498355.692342:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498355.692472:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885559296:12345-0@lo:13: Request processed in 163us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498355.692479:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789498355.692530:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb2e2680 x1876424885559296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498355.692615:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789498355.692639:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885559296:0@lo:13: 00000100:00100000:3.0:1789498355.693309:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885559424:0@lo:13: 00000100:00100000:3.0:1789498355.693356:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498355.713129:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885559424 00000100:00100000:0.0:1789498355.713147:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885559424 00000100:00100000:0.0:1789498355.713216:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498355.713226:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885559424:12345-0@lo:13: 00002000:00000024:0.0:1789498355.713268:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498355.713343:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885559424:12345-0@lo:13: Request processed in 119us (19987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498355.713351:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789498355.722333:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb3eaa00 x1876424885559424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498355.722362:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885559424:0@lo:13: 00000100:00100000:3.0:1789498355.780004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498355.780080:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864563328 00000100:00100000:0.0:1789498355.780114:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864563328 00000100:00100000:0.0:1789498355.780167:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 113 00000100:00100000:0.0:1789498355.780176:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2354:x1876424864563328:12345-192.168.201.20@tcp:250: 00010000:00080000:0.0:1789498355.780204:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea@192.168.201.20@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:0.0:1789498355.780258:0:5840:0:(genops.c:1384:class_connect()) connect: client 5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea, cookie 0x3a6cb1946bc18164 00000100:00080000:0.0:1789498355.780531:0:5840:0:(import.c:65:import_set_state_nolock()) ffff98e987727000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498355.783907:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+5:2354:x1876424864563328:12345-192.168.201.20@tcp:250: Request processed in 3718us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498355.783924:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 113 00000100:00100000:1.0:1789498355.798430:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498355.798800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864563456 00000100:00100000:1.0:1789498355.798810:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864563456 00000100:00100000:1.0:1789498355.798876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:1.0:1789498355.798887:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+5:5586:x1876424864563456:12345-192.168.201.20@tcp:101: 00010000:00010000:1.0:1789498355.798917:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498355.801263:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99ecc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.801308:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.801322:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.801448:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddfc00, rc 0) 00000100:00100000:1.0:1789498355.801515:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+6:5586:x1876424864563456:12345-192.168.201.20@tcp:101: Request processed in 2630us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498355.801523:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:3.0:1789498355.805783:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498355.805818:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864563584 00000100:00100000:3.0:1789498355.805828:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864563584 00000100:00100000:3.0:1789498355.805878:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 115 00000100:00100000:3.0:1789498355.805889:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+6:5586:x1876424864563584:12345-192.168.201.20@tcp:501: 00000100:00100000:3.0:1789498355.806136:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+6:5586:x1876424864563584:12345-192.168.201.20@tcp:501: Request processed in 248us (362us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498355.806145:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 115 00000100:00100000:3.0:1789498355.823269:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498355.823396:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864563712 00000100:00100000:1.0:1789498355.823407:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864563712 00000100:00100000:1.0:1789498355.823462:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1789498355.823473:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+6:5586:x1876424864563712:12345-192.168.201.20@tcp:101: 00010000:00010000:1.0:1789498355.823489:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498355.823506:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99ed3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.823534:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.823545:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.823553:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde600, rc 0) 00000100:00100000:1.0:1789498355.823623:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+7:5586:x1876424864563712:12345-192.168.201.20@tcp:101: Request processed in 152us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498355.823630:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1789498355.829707:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498355.829821:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864563840 00000100:00100000:2.0:1789498355.829834:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864563840 00000100:00100000:2.0:1789498355.829895:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:2.0:1789498355.829906:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+7:5586:x1876424864563840:12345-192.168.201.20@tcp:501: 00000100:00100000:3.0:1789498355.830493:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5586:x1876424864563840:12345-192.168.201.20@tcp:501: Request processed in 587us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498355.830503:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:3.0:1789498355.837136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498355.837613:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864563968 00000100:00100000:0.0:1789498355.837625:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864563968 00000100:00100000:0.0:1789498355.837694:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:0.0:1789498355.837705:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5586:x1876424864563968:12345-192.168.201.20@tcp:503: 00000100:00100000:0.0:1789498355.837990:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5586:x1876424864563968:12345-192.168.201.20@tcp:503: Request processed in 285us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498355.837999:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:2.0:1789498355.840330:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498355.840422:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864564096 00000100:00100000:1.0:1789498355.840433:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864564096 00000100:00100000:1.0:1789498355.840496:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:1.0:1789498355.840507:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5605:x1876424864564096:12345-192.168.201.20@tcp:502: 00000100:00100000:1.0:1789498355.840829:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5605:x1876424864564096:12345-192.168.201.20@tcp:502: Request processed in 323us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498355.840838:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:3.0:1789498355.876439:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498355.876478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864564224 00000100:00100000:3.0:1789498355.876489:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864564224 00000100:00100000:3.0:1789498355.876540:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:3.0:1789498355.876550:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5605:x1876424864564224:12345-192.168.201.20@tcp:502: 00000100:00100000:3.0:1789498355.876860:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5605:x1876424864564224:12345-192.168.201.20@tcp:502: Request processed in 310us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498355.876869:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:1.0:1789498355.892628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498355.892684:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864564352 00000100:00100000:1.0:1789498355.892695:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864564352 00000100:00100000:1.0:1789498355.892746:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:1.0:1789498355.892756:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5586:x1876424864564352:12345-192.168.201.20@tcp:101: 00010000:00010000:1.0:1789498355.892774:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498355.892794:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddfe00/0x3a6cb1946bc18179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99efd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.892827:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddfe00/0x3a6cb1946bc18179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99efd expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.892839:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddfe00/0x3a6cb1946bc18179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99efd expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.892848:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddfe00, rc 0) 00000100:00100000:1.0:1789498355.892904:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5586:x1876424864564352:12345-192.168.201.20@tcp:101: Request processed in 148us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498355.895488:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:2.0:1789498355.905980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498355.907071:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864564480 00000100:00100000:2.0:1789498355.907084:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864564480 00000100:00100000:2.0:1789498355.907153:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:2.0:1789498355.907164:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5586:x1876424864564480:12345-192.168.201.20@tcp:256: 20000000:01000000:2.0:1789498355.907189:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789498355.907208:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789498355.907212:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789498355.907215:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789498355.907218:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789498355.942820:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5586:x1876424864564480:12345-192.168.201.20@tcp:256: Request processed in 35643us (36836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498355.942836:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:3.0:1789498355.947296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498355.947401:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864564608 00000100:00100000:1.0:1789498355.947411:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864564608 00000100:00100000:1.0:1789498355.947470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:1.0:1789498355.947480:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea88529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5586:x1876424864564608:12345-192.168.201.20@tcp:101: 00010000:00010000:1.0:1789498355.947496:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498355.947523:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99f04 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.947551:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.947563:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498355.947572:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf400, rc 0) 00000100:00100000:1.0:1789498355.947640:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea88529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5586:x1876424864564608:12345-192.168.201.20@tcp:101: Request processed in 162us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498355.947647:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:1.0:1789498355.951479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498355.951565:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864564736 00000100:00100000:3.0:1789498355.951575:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864564736 00000100:00100000:3.0:1789498355.951638:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:3.0:1789498355.951648:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5586:x1876424864564736:12345-192.168.201.20@tcp:501: 00000100:00100000:3.0:1789498355.952057:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5586:x1876424864564736:12345-192.168.201.20@tcp:501: Request processed in 409us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498355.952066:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:3.0:1789498355.954496:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498355.965423:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864564864 00000100:00100000:2.0:1789498355.965456:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864564864 00000100:00100000:2.0:1789498355.967718:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:2.0:1789498355.967731:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5586:x1876424864564864:12345-192.168.201.20@tcp:503: 00000100:00100000:2.0:1789498355.968393:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5586:x1876424864564864:12345-192.168.201.20@tcp:503: Request processed in 662us (13903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498355.968402:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:2.0:1789498355.977679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498355.977772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864564992 00000100:00100000:3.0:1789498355.977782:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864564992 00000100:00100000:3.0:1789498355.977835:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:3.0:1789498355.977845:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea88528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5610:x1876424864564992:12345-192.168.201.20@tcp:502: 00000100:00100000:3.0:1789498355.978138:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea88528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5610:x1876424864564992:12345-192.168.201.20@tcp:502: Request processed in 293us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498355.978146:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:0.0:1789498355.991038:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498355.996082:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864565120 00000100:00100000:3.0:1789498355.996124:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864565120 00000100:00100000:3.0:1789498355.996180:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 127 00000100:00100000:3.0:1789498355.996191:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5610:x1876424864565120:12345-192.168.201.20@tcp:502: 00000100:00100000:3.0:1789498355.996446:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5610:x1876424864565120:12345-192.168.201.20@tcp:502: Request processed in 256us (5417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498355.996455:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 127 00000100:00100000:3.0:1789498356.006392:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498356.007044:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864565248 00000100:00100000:0.0:1789498356.007059:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864565248 00000100:00100000:0.0:1789498356.007140:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:0.0:1789498356.007150:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1876424864565248:12345-192.168.201.20@tcp:38: 00010000:00080000:3.0:1789498356.007408:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1789498356.007797:0:5847:0:(genops.c:1384:class_connect()) connect: client 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c, cookie 0x3a6cb1946bc18187 00000004:00100000:3.0:1789498356.007845:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789498356.007853:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789498356.122017:0:5847:0:(import.c:65:import_set_state_nolock()) ffff98eaba057000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498356.122147:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2354:x1876424864565248:12345-192.168.201.20@tcp:38: Request processed in 114996us (115772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498356.122233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00010000:00010000:3.0:1789498356.651506:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498357.143999:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498357.144271:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864565376 00000100:00100000:1.0:1789498357.144287:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864565376 00000100:00100000:1.0:1789498357.144394:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:1.0:1789498357.144408:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:0:x1876424864565376:12345-192.168.201.20@tcp:41: 00000004:00000024:1.0:1789498357.144469:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:1.0:1789498357.144564:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:0:x1876424864565376:12345-192.168.201.20@tcp:41: Request processed in 159us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498357.144592:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00080000:2.0:1789498357.144739:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498357.168179:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498357.170840:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864565504 00000100:00100000:2.0:1789498357.170865:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864565504 00000100:00100000:2.0:1789498357.170977:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1789498357.170991:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5586:x1876424864565504:12345-192.168.201.20@tcp:41: 00000004:00000024:2.0:1789498357.171042:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1789498357.171233:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5586:x1876424864565504:12345-192.168.201.20@tcp:41: Request processed in 244us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498357.171242:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:0.0:1789498357.177479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498357.177844:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864565632 00000100:00100000:1.0:1789498357.177861:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864565632 00000100:00100000:1.0:1789498357.177952:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1789498357.177964:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5586:x1876424864565632:12345-192.168.201.20@tcp:40: 00000100:00100000:1.0:1789498357.178126:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5586:x1876424864565632:12345-192.168.201.20@tcp:40: Request processed in 163us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498357.178134:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1789498357.202916:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498357.202969:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498357.203007:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498357.203062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498357.203557:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864566016 00000100:00100000:3.0:1789498357.203574:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864566016 00000100:00100000:3.0:1789498357.203653:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:3.0:1789498357.203670:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5586:x1876424864566016:12345-192.168.201.20@tcp:33: 00000100:00100000:2.0:1789498357.204170:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864565760 00000100:00100000:2.0:1789498357.204178:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864565760 00000100:00100000:2.0:1789498357.204221:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864565888 00000100:00100000:2.0:1789498357.204225:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864565888 00000100:00100000:2.0:1789498357.204239:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498357.204246:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1876424864565760:12345-192.168.201.20@tcp:8: 00010000:00080000:2.0:1789498357.204277:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1789498357.204315:0:6701:0:(genops.c:1384:class_connect()) connect: client 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c, cookie 0x3a6cb1946bc1818e 00002000:00100000:2.0:1789498357.204329:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c/ffff98ea89105800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789498357.204364:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789498357.205064:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789498357.205270:0:6701:0:(import.c:65:import_set_state_nolock()) ffff98ea89103000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498357.205371:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2354:x1876424864565760:12345-192.168.201.20@tcp:8: Request processed in 1122us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498357.205382:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498357.205413:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1789498357.205419:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1876424864565888:12345-192.168.201.20@tcp:8: 00010000:00080000:2.0:1789498357.205442:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1789498357.205468:0:6701:0:(genops.c:1384:class_connect()) connect: client 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c, cookie 0x3a6cb1946bc18195 00002000:00100000:2.0:1789498357.205476:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c/ffff98ea89101000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789498357.205485:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789498357.205875:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864566144 00000100:00100000:0.0:1789498357.205885:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864566144 00000100:00100000:0.0:1789498357.205928:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00100000:0.0:1789498357.205936:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864566144:12345-192.168.201.20@tcp:400: 00000100:00100000:0.0:1789498357.205982:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864566144:12345-192.168.201.20@tcp:400: Request processed in 46us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498357.205989:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 128 00002000:00080000:2.0:1789498357.208176:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789498357.209665:0:6701:0:(import.c:65:import_set_state_nolock()) ffff98ea89106800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498357.209795:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2354:x1876424864565888:12345-192.168.201.20@tcp:8: Request processed in 4369us (6782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498357.209810:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000004:00080000:3.0:1789498357.227455:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23681us 00000004:00200000:2.0:1789498357.268078:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789498357.268463:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5586:x1876424864566016:12345-192.168.201.20@tcp:33: Request processed in 64791us (65557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498357.268485:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000001:00100000:0.0:1789498357.366588:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000100:00100000:0.0:1789498357.467775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498357.467919:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864566272 00000100:00100000:2.0:1789498357.467934:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864566272 00000100:00100000:2.0:1789498357.468186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498357.468199:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5627:x1876424864566272:12345-192.168.201.20@tcp:101: 00010000:00010000:2.0:1789498357.468247:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498357.468295:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554e00/0x3a6cb1946bc1819c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99f2e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498357.468385:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc181a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498357.468403:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc181a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498357.468421:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc181a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498357.468475:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498357.468479:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498357.468497:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc181a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498357.468528:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554e00/0x3a6cb1946bc1819c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f2e expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498357.468551:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc181a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f2e expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498357.468561:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46e00) 00010000:00010000:2.0:1789498357.468564:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498357.468568:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6555000, rc 0) 00000100:00100000:2.0:1789498357.468634:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:5627:x1876424864566272:12345-192.168.201.20@tcp:101: Request processed in 438us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498357.468653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00010000:00010000:3.0:1789498357.676849:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498358.699732:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498359.725018:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498359.758581:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498359.758712:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864566400 00000100:00100000:1.0:1789498359.758726:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864566400 00000100:00100000:1.0:1789498359.758812:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1789498359.758824:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:5680:x1876424864566400:12345-192.168.201.20@tcp:41: 00000004:00000024:1.0:1789498359.758881:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:1.0:1789498359.758971:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:5680:x1876424864566400:12345-192.168.201.20@tcp:41: Request processed in 149us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498359.758978:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00080000:2.0:1789498359.759359:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498359.768438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498359.768569:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864566528 00000100:00100000:2.0:1789498359.768584:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864566528 00000100:00100000:2.0:1789498359.768704:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498359.768717:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:5680:x1876424864566528:12345-192.168.201.20@tcp:13: 00002000:00000024:2.0:1789498359.768778:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498359.768871:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:5680:x1876424864566528:12345-192.168.201.20@tcp:13: Request processed in 158us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498359.768878:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00080000:1.0:1789498359.769477:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498359.771506:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498359.771622:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864566656 00000100:00100000:2.0:1789498359.771636:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864566656 00000100:00100000:2.0:1789498359.771729:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498359.771739:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5680:x1876424864566656:12345-192.168.201.20@tcp:13: 00002000:00000024:2.0:1789498359.771781:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498359.771849:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:5680:x1876424864566656:12345-192.168.201.20@tcp:13: Request processed in 111us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498359.771856:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00080000:1.0:1789498359.772250:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498360.306726:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885559936:0@lo:400: 00000100:00100000:1.0:1789498360.306836:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498360.306925:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498360.306933:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885559808:0@lo:400: 00000100:00100000:1.0:1789498360.306970:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498360.307013:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885559808 00000100:00100000:1.0:1789498360.307023:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885559808 00000100:00100000:1.0:1789498360.307123:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498360.307136:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885559808:12345-0@lo:400: 00000100:00100000:1.0:1789498360.307207:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885559808:12345-0@lo:400: Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498360.307214:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789498360.307247:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498360.307286:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885559808:0@lo:400: 00000100:00100000:3.0:1789498360.307413:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885559680:0@lo:400: 00000100:00100000:3.0:1789498360.307452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498360.307489:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885560192:0@lo:400: 00000100:00100000:3.0:1789498360.307529:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498360.307560:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789498360.307567:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885559552:0@lo:400: 00000100:00100000:3.0:1789498360.307611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498360.307633:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885560064:0@lo:400: 00000100:00100000:3.0:1789498360.307657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498360.307687:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885559936 00000100:00100000:3.0:1789498360.307692:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885559936 00000100:00100000:3.0:1789498360.307727:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885560192 00000100:00100000:3.0:1789498360.307729:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885560192 00000100:00100000:3.0:1789498360.307748:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498360.307755:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885559936:12345-0@lo:400: 00000100:00100000:3.0:1789498360.307800:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885559936:12345-0@lo:400: Request processed in 45us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498360.307806:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498360.307822:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498360.307829:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885560192:12345-0@lo:400: 00000100:00100000:3.0:1789498360.307861:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885560192:12345-0@lo:400: Request processed in 33us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498360.307868:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498360.307886:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885559680 00000100:00100000:3.0:1789498360.307889:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885559680 00000100:00100000:3.0:1789498360.307908:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885560064 00000100:00100000:3.0:1789498360.307911:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885560064 00000100:00100000:3.0:1789498360.307926:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498360.307932:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885559680:12345-0@lo:400: 00000100:00100000:3.0:1789498360.307965:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885559680:12345-0@lo:400: Request processed in 33us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498360.307979:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498360.307991:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498360.307998:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885560064:12345-0@lo:400: 00000100:00100000:3.0:1789498360.308029:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885560064:12345-0@lo:400: Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498360.308035:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498360.308066:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885560064:0@lo:400: 00000100:00100000:3.0:1789498360.308077:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885559680:0@lo:400: 00010000:00080000:3.0:1789498360.308119:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fa8a80 x1876424885560192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498360.308131:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885560192:0@lo:400: 00000100:00100000:1.0:1789498360.308457:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885559552 00000100:00100000:1.0:1789498360.308461:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885559552 00000100:00100000:1.0:1789498360.308491:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789498360.308503:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885559552:12345-0@lo:400: 00000100:00080000:0.0:1789498360.308539:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498360.308544:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498360.308547:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498360.308552:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885559552:12345-0@lo:400: Request processed in 50us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498360.308559:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:0.0:1789498360.308579:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fa8380 x1876424885559936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498360.308607:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885559936:0@lo:400: 00000100:00100000:3.0:1789498360.308867:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885559552:0@lo:400: 00010000:00010000:3.0:1789498360.748613:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498360.811415:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498360.811450:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885560320:0@lo:13: 00000100:00100000:2.0:1789498360.811562:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498360.811908:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885560320 00000100:00100000:3.0:1789498360.811919:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885560320 00000100:00100000:3.0:1789498360.811991:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498360.812002:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885560320:12345-0@lo:13: 00002000:00000024:3.0:1789498360.812032:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498360.812122:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885560320:12345-0@lo:13: Request processed in 121us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498360.812130:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789498360.812454:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea8535dc00 x1876424885560320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498360.812478:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885560320:0@lo:13: 00000100:00100000:1.0:1789498360.822477:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498360.824600:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885560448:0@lo:13: 00000100:00100000:1.0:1789498360.824746:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498360.824853:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885560448 00000100:00100000:1.0:1789498360.824865:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885560448 00000100:00100000:1.0:1789498360.824932:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498360.824944:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885560448:12345-0@lo:13: 00002000:00000024:1.0:1789498360.824983:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498360.825042:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885560448:12345-0@lo:13: Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498360.825061:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789498360.825135:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fa8700 x1876424885560448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498360.825378:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885560448:0@lo:13: 00000001:00100000:0.0:1789498361.473490:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00010000:00010000:3.0:1789498361.772862:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789498361.893825:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000100:00100000:0.0:1789498362.254281:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498362.254328:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498362.254398:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498362.254436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498362.254475:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864567040 00000100:00100000:0.0:1789498362.254487:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864567040 00000100:00100000:0.0:1789498362.254571:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864567168 00000100:00100000:0.0:1789498362.254575:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864567168 00000100:00100000:0.0:1789498362.254599:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498362.254610:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864567040:12345-192.168.201.20@tcp:400: 00000100:00100000:0.0:1789498362.254711:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864567040:12345-192.168.201.20@tcp:400: Request processed in 102us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498362.254720:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498362.254744:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:0.0:1789498362.254751:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864567168:12345-192.168.201.20@tcp:400: 00000100:00100000:0.0:1789498362.254777:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864567168:12345-192.168.201.20@tcp:400: Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498362.254923:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00080000:0.0:1789498362.254945:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498362.254951:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498362.255202:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864566784 00000100:00100000:3.0:1789498362.255208:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864566784 00000100:00100000:3.0:1789498362.255267:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:3.0:1789498362.255277:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2355:x1876424864566784:12345-192.168.201.20@tcp:400: 00000100:00100000:3.0:1789498362.255321:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2355:x1876424864566784:12345-192.168.201.20@tcp:400: Request processed in 45us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498362.255328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:3.0:1789498362.255364:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864566912 00000100:00100000:3.0:1789498362.255368:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864566912 00000100:00100000:3.0:1789498362.255409:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:3.0:1789498362.255416:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864566912:12345-192.168.201.20@tcp:400: 00000100:00100000:3.0:1789498362.255448:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864566912:12345-192.168.201.20@tcp:400: Request processed in 33us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498362.255454:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00080000:3.0:1789498362.255622:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789498362.804576:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789498362.968795:0:8310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789498363.821917:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498364.844277:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498365.420142:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885560704:0@lo:400: 00000100:00100000:1.0:1789498365.420213:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498365.420270:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885561216:0@lo:400: 00000100:00100000:1.0:1789498365.420297:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498365.420379:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789498365.420386:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885560576:0@lo:400: 00000100:00100000:1.0:1789498365.420417:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498365.420439:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885561088:0@lo:400: 00000100:00100000:1.0:1789498365.420459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498365.420485:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885560832:0@lo:400: 00000100:00100000:1.0:1789498365.420516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498365.420546:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498365.420551:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885560960:0@lo:400: 00000100:00100000:1.0:1789498365.420574:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498365.420613:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885560576 00000100:00100000:0.0:1789498365.420613:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885561216 00000100:00100000:1.0:1789498365.420622:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885560576 00000100:00100000:0.0:1789498365.420622:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885561216 00000100:00100000:0.0:1789498365.420665:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885560960 00000100:00100000:0.0:1789498365.420667:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885560960 00000100:00100000:1.0:1789498365.420668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789498365.420676:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885560576:12345-0@lo:400: 00000100:00100000:0.0:1789498365.420683:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498365.420689:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885561216:12345-0@lo:400: 00000100:00100000:0.0:1789498365.420727:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885561216:12345-0@lo:400: Request processed in 38us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498365.420734:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498365.420751:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498365.420758:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885560960:12345-0@lo:400: 00000100:00100000:2.0:1789498365.420759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885560704 00000100:00100000:0.0:1789498365.420787:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885560960:12345-0@lo:400: Request processed in 30us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498365.420789:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885560704 00000100:00100000:0.0:1789498365.420793:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789498365.420810:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498365.420816:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498365.420820:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885561088 00000100:00100000:2.0:1789498365.420823:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885561088 00010000:00080000:0.0:1789498365.421179:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea874be680 x1876424885560960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498365.421195:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885560960:0@lo:400: 00000100:00100000:3.0:1789498365.421599:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885560832 00000100:00100000:3.0:1789498365.421605:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885560832 00000100:00100000:1.0:1789498365.423333:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885560576:12345-0@lo:400: Request processed in 2648us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498365.423347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789498365.423434:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789498365.423482:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885560576:0@lo:400: 00010000:00080000:0.0:1789498365.423516:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea874bc700 x1876424885561216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498365.423536:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885561216:0@lo:400: 00000100:00100000:1.0:1789498365.425451:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885560704:12345-0@lo:400: 00000100:00100000:1.0:1789498365.425991:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885560704:12345-0@lo:400: Request processed in 2544us (5774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498365.426002:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789498365.426596:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885560704:0@lo:400: 00000100:00100000:3.0:1789498365.426832:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498365.426843:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885560832:12345-0@lo:400: 00000100:00100000:3.0:1789498365.426901:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885560832:12345-0@lo:400: Request processed in 60us (6383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498365.426907:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789498365.428599:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498365.428656:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885560832:0@lo:400: 00000100:00100000:2.0:1789498365.429107:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789498365.429119:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885561088:12345-0@lo:400: 00000100:00100000:2.0:1789498365.429220:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885561088:12345-0@lo:400: Request processed in 104us (8759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498365.429227:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789498365.429306:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885561088:0@lo:400: 00010000:00010000:3.0:1789498365.867306:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498365.932078:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885561344:0@lo:13: 00000100:00100000:0.0:1789498365.932190:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498365.932638:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885561344 00000100:00100000:1.0:1789498365.932648:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885561344 00000100:00100000:1.0:1789498365.932707:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789498365.932718:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885561344:12345-0@lo:13: 00002000:00000024:1.0:1789498365.932772:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498365.932858:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885561344:12345-0@lo:13: Request processed in 142us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498365.932865:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789498365.934591:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fab800 x1876424885561344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498365.934631:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885561344:0@lo:13: 00000100:00100000:0.0:1789498365.934655:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498365.934664:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885561472:0@lo:13: 00000100:00100000:0.0:1789498365.934714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498365.935306:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885561472 00000100:00100000:1.0:1789498365.935316:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885561472 00000100:00100000:1.0:1789498365.935370:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498365.935380:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885561472:12345-0@lo:13: 00002000:00000024:1.0:1789498365.935422:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498365.935498:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885561472:12345-0@lo:13: Request processed in 119us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498365.935505:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789498365.935654:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fa9f80 x1876424885561472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498365.935672:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885561472:0@lo:13: 00000020:00000080:3.0:1789498366.709242:0:8458:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca3e8a300 20000000:00000080:3.0:1789498366.709262:0:8458:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98eaba4c7800 uarg=0000000000000000 20000000:01000000:3.0:1789498366.709587:0:8458:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789498366.709590:0:8458:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789498366.709593:0:8458:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789498366.709598:0:8458:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789498366.709612:0:8458:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789498366.709626:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789498366.709628:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789498366.710779:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789498366.710785:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789498366.712887:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789498366.713920:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789498366.714002:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789498366.714043:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789498366.714058:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789498366.714061:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789498366.716857:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789498366.717875:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789498366.717939:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789498366.718016:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789498366.718032:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789498366.718035:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789498366.722160:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789498366.722700:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789498366.722749:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789498366.722804:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789498366.722815:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789498366.722817:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789498366.725388:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789498366.725818:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789498366.725892:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789498366.725935:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1789498366.725954:0:8458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789498366.725975:0:8458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.725994:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.726003:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.726010:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.726017:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.726023:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.726029:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.726043:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.726053:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727041:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727050:0:8458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727121:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727138:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 9 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.727153:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885561600:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498366.727261:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727269:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 9 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.727277:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885561728:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498366.727308:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727332:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 18 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.727344:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885561856:0@lo:104: 00000100:00100000:2.0:1789498366.727418:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498366.727455:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498366.727463:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885561856 00010000:00010000:2.0:1789498366.727465:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 18 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498366.727484:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885561856 00000100:00100000:2.0:1789498366.727488:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885561984:0@lo:104: 00000100:00100000:2.0:1789498366.727523:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498366.727798:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727808:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 18 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.727818:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562112:0@lo:104: 00010000:00010000:2.0:1789498366.727848:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727855:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 18 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.727863:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562240:0@lo:104: 00010000:00010000:2.0:1789498366.727920:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727937:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 18 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.727944:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562368:0@lo:104: 00010000:00010000:2.0:1789498366.727975:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.727982:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 18 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.727990:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562496:0@lo:104: 00010000:00010000:2.0:1789498366.728012:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.728018:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 18 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.728025:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562624:0@lo:104: 00000100:00100000:2.0:1789498366.728040:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f5c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498366.731454:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885561600:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498366.731483:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885561728:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498366.732477:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789498366.732521:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498366.732543:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498366.732554:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498366.732583:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498366.732594:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498366.732602:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:1.0:1789498366.732605:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885561984 00000100:00100000:3.0:1789498366.732607:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885562112 00000100:00100000:3.0:1789498366.732612:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885562112 00000100:00100000:1.0:1789498366.732612:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885561984 00000100:00100000:2.0:1789498366.732774:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885562240 00000100:00100000:2.0:1789498366.732779:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885562240 00000100:00100000:2.0:1789498366.732791:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885562368 00000100:00100000:2.0:1789498366.732794:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885562368 00000100:00100000:2.0:1789498366.732804:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885562496 00000100:00100000:2.0:1789498366.732806:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885562496 00000100:00100000:2.0:1789498366.732814:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885562624 00000100:00100000:2.0:1789498366.732826:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885562624 00000100:00100000:2.0:1789498366.732842:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498366.732853:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:8458:x1876424885561856:12345-0@lo:104: 00010000:00010000:2.0:1789498366.732871:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.732954:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498366.732962:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+9:8458:x1876424885561856:12345-0@lo:104: Request processed in 112us (5544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.732970:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498366.732990:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885561856:0@lo:104: 00000100:00100000:2.0:1789498366.732996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498366.733005:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98645dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+8:8458:x1876424885561984:12345-0@lo:104: 00010000:00010000:2.0:1789498366.733015:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498366.733171:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885561984:0@lo:104: 00010000:00010000:2.0:1789498366.733220:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789498366.733228:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98645dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+8:8458:x1876424885561984:12345-0@lo:104: Request processed in 225us (5705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.733235:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789498366.733240:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498366.733248:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733258:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80031400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498366.733263:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.733272:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498366.733279:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+7:8458:x1876424885562112:12345-0@lo:104: 00010000:00010000:2.0:1789498366.733287:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.733329:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789498366.733334:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+7:8458:x1876424885562112:12345-0@lo:104: Request processed in 57us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.733339:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498366.733357:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498366.733362:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+6:8458:x1876424885562240:12345-0@lo:104: 00010000:00010000:2.0:1789498366.733370:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.733399:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789498366.733404:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+6:8458:x1876424885562240:12345-0@lo:104: Request processed in 42us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.733409:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498366.733420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498366.733425:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:8458:x1876424885562368:12345-0@lo:104: 00010000:00010000:2.0:1789498366.733432:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.733459:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789498366.733464:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:8458:x1876424885562368:12345-0@lo:104: Request processed in 40us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.733484:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498366.733496:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498366.733502:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:8458:x1876424885562496:12345-0@lo:104: 00010000:00010000:2.0:1789498366.733509:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.733534:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789498366.733539:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:8458:x1876424885562496:12345-0@lo:104: Request processed in 39us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.733545:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498366.733564:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789498366.733573:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:8458:x1876424885562624:12345-0@lo:104: 00010000:00010000:3.0:1789498366.733588:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.733589:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498366.733600:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498366.733606:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498366.733641:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733648:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498366.733666:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733674:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80031400/0x3a6cb1946bc18156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1815d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733686:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789498366.733690:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733695:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80031200 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498366.733698:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733705:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498366.733712:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498366.733724:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789498366.733738:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562112:0@lo:104: 00010000:00010000:3.0:1789498366.733741:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733748:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789498366.733752:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562240:0@lo:104: 00010000:00010000:3.0:1789498366.733756:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498366.733762:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562368:0@lo:104: 00010000:00010000:3.0:1789498366.733765:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc1812c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18133 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498366.733772:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562496:0@lo:104: 00010000:00010000:3.0:1789498366.733778:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789498366.733783:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733788:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498366.733791:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733797:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498366.733803:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498366.733815:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498366.733833:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733839:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498366.733861:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733868:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc18110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18117 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733878:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789498366.733881:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733886:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030e00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498366.733889:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733896:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.733897:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:3.0:1789498366.733910:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.733910:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:8458:x1876424885562624:12345-0@lo:104: Request processed in 337us (1311us total) trans 0 rc 0/0 10000000:01000000:3.0:1789498366.733925:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789498366.733926:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789498366.733942:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.733947:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789498366.733949:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498366.733958:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.733963:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885563136:0@lo:103: 00010000:00010000:3.0:1789498366.733980:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80030e00/0x3a6cb1946bc18102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18109 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.733991:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789498366.733999:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789498366.734002:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734009:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498366.734013:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734021:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498366.734027:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.734033:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885563008:0@lo:103: 10000000:01000000:3.0:1789498366.734035:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498366.734067:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734074:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498366.734079:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.734083:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498366.734137:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885563136 00000100:00100000:2.0:1789498366.734142:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885563136 00010000:00010000:2.0:1789498366.734165:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 19 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.734186:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885563008 00000100:00100000:2.0:1789498366.734188:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885563008 00010000:00010000:2.0:1789498366.734199:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 20 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.734210:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498366.734216:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3308:x1876424885563136:12345-0@lo:103: 00010000:00010000:2.0:1789498366.734226:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498366.734233:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 20 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.734248:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 20 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.734263:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc18109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc18102 expref: 20 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.734275:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498366.734304:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885563136:12345-0@lo:103: Request processed in 88us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.734310:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498366.734323:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498366.734330:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:3308:x1876424885563008:12345-0@lo:103: 00010000:00010000:2.0:1789498366.734337:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498366.734342:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 18 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.734350:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 18 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.734360:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80030200/0x3a6cb1946bc18117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc18110 expref: 18 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.734369:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498366.734390:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:3308:x1876424885563008:12345-0@lo:103: Request processed in 61us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.734395:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498366.734425:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885563136:0@lo:103: 00000100:00100000:2.0:1789498366.734433:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885563008:0@lo:103: 00010000:00010000:3.0:1789498366.734715:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc180f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734727:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498366.734730:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734736:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dac00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498366.734739:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734756:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498366.734762:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498366.734767:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498366.734784:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734789:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498366.734795:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734801:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc180ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180d1 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734811:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498366.734814:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734819:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498366.734822:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734828:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498366.734835:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498366.734845:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498366.734860:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734866:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498366.734888:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734895:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc180a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180a7 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.734909:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498366.734911:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498366.734912:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498366.734956:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498366.734978:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885563520:0@lo:103: 00000100:00100000:2.0:1789498366.735008:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498366.735184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498366.735220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498366.735221:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885563520 00000100:00100000:2.0:1789498366.735226:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885563520 00010000:00010000:0.0:1789498366.735236:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498366.735244:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 17 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.735258:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864567296 00000100:00100000:2.0:1789498366.735261:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864567296 00000100:00100000:0.0:1789498366.735270:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885562752:0@lo:103: 00010000:00010000:2.0:1789498366.735272:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 10 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498366.735301:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498366.735314:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885563264:0@lo:103: 00000100:00100000:0.0:1789498366.735335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498366.735347:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789498366.735352:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885562880:0@lo:103: 00000100:00100000:2.0:1789498366.735368:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864567424 00000100:00100000:2.0:1789498366.735371:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864567424 00000100:00100000:0.0:1789498366.735371:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498366.735380:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885563392:0@lo:103: 00010000:00010000:2.0:1789498366.735383:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 11 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.735393:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885562752 00000100:00100000:2.0:1789498366.735396:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885562752 00000100:00100000:0.0:1789498366.735397:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498366.735405:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 18 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.735414:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885563264 00000100:00100000:2.0:1789498366.735416:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885563264 00010000:00010000:2.0:1789498366.735426:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 19 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.735435:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885562880 00000100:00100000:2.0:1789498366.735437:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885562880 00010000:00010000:2.0:1789498366.735447:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 20 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498366.735480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885563392 00000100:00100000:2.0:1789498366.735484:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885563392 00010000:00010000:2.0:1789498366.735495:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 21 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498366.735606:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498366.735616:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+21:3308:x1876424885563520:12345-0@lo:103: 00010000:00010000:3.0:1789498366.735628:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498366.735633:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 21 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735643:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 21 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735657:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498366.735702:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+21:3308:x1876424885563520:12345-0@lo:103: Request processed in 88us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498366.735709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498366.735732:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498366.735739:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:2355:x1876424864567296:12345-192.168.201.20@tcp:103: 00010000:00010000:3.0:1789498366.735753:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498366.735758:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 11 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735767:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 11 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735778:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc18172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ed3 expref: 11 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735787:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498366.735800:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885563520:0@lo:103: 00000100:00100000:3.0:1789498366.735822:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2355:x1876424864567296:12345-192.168.201.20@tcp:103: Request processed in 84us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498366.735829:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498366.735844:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:3.0:1789498366.735850:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:2356:x1876424864567424:12345-192.168.201.20@tcp:103: 00010000:00010000:3.0:1789498366.735859:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498366.735864:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 9 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735874:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 9 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735884:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc1816b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ecc expref: 9 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735892:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498366.735909:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:2356:x1876424864567424:12345-192.168.201.20@tcp:103: Request processed in 60us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498366.735921:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:3.0:1789498366.735934:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498366.735939:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3305:x1876424885562752:12345-0@lo:103: 00010000:00010000:3.0:1789498366.735947:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498366.735951:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 20 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735972:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 20 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735982:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1815d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc18156 expref: 20 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.735991:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498366.736026:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885562752:12345-0@lo:103: Request processed in 87us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498366.736031:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498366.736042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498366.736048:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85660c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:3305:x1876424885563264:12345-0@lo:103: 00010000:00010000:3.0:1789498366.736055:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498366.736058:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 18 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.736065:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 18 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.736074:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddee00/0x3a6cb1946bc180fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc180f4 expref: 18 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.736109:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498366.736131:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85660c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:3305:x1876424885563264:12345-0@lo:103: Request processed in 83us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498366.736137:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789498366.736148:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885562752:0@lo:103: 00000100:00100000:0.0:1789498366.736155:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885563264:0@lo:103: 00000100:00100000:3.0:1789498366.736167:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498366.736172:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3305:x1876424885562880:12345-0@lo:103: 00010000:00010000:3.0:1789498366.736179:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498366.736183:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 16 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.736191:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 16 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.736200:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80031e00/0x3a6cb1946bc18133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc1812c expref: 16 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498366.736208:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498366.736239:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:3305:x1876424885562880:12345-0@lo:103: Request processed in 67us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498366.736245:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789498366.736380:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885562880:0@lo:103: 00000100:00100000:2.0:1789498366.736428:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498366.736436:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:3305:x1876424885563392:12345-0@lo:103: 00010000:00010000:2.0:1789498366.736443:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498366.736448:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 14 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736457:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 14 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736467:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc180d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc180ca expref: 14 pid: 5839 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736488:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736498:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736706:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736713:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736720:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736733:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736739:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498366.736743:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736750:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736759:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498366.736768:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498366.736807:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:3305:x1876424885563392:12345-0@lo:103: Request processed in 372us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498366.736813:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789498366.737029:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80030a00/0x3a6cb1946bc180a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc180a0 expref: 12 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498366.737044:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1876424885562624:0@lo:104: 00010000:00010000:1.0:1789498366.737204:0:8458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498366.737215:0:8458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498366.737221:0:8458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498366.737227:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498366.737781:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885563392:0@lo:103: 00010000:00010000:3.0:1789498366.892220:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498367.374766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498367.374877:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498367.374931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498367.375115:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864567552 00000100:00100000:1.0:1789498367.375125:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864567552 00000100:00100000:1.0:1789498367.375198:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:1.0:1789498367.375210:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864567552:12345-192.168.201.20@tcp:400: 00000100:00100000:1.0:1789498367.375285:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864567552:12345-192.168.201.20@tcp:400: Request processed in 76us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498367.375306:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1789498367.375381:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864567680 00000100:00100000:2.0:1789498367.375386:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864567680 00000100:00100000:2.0:1789498367.375421:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864567808 00000100:00100000:2.0:1789498367.375424:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864567808 00000100:00100000:2.0:1789498367.375445:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498367.375452:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864567680:12345-192.168.201.20@tcp:400: 00000100:00100000:2.0:1789498367.375642:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864567680:12345-192.168.201.20@tcp:400: Request processed in 189us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498367.375649:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498367.375666:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:2.0:1789498367.375674:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864567808:12345-192.168.201.20@tcp:400: 00000100:00100000:2.0:1789498367.375722:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864567808:12345-192.168.201.20@tcp:400: Request processed in 48us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498367.375730:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00080000:3.0:1789498367.375737:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498367.375743:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498367.375747:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498367.823575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498367.825199:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864567936 00000100:00100000:0.0:1789498367.825214:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864567936 00000100:00100000:0.0:1789498367.825291:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:0.0:1789498367.825302:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:5600:x1876424864567936:12345-192.168.201.20@tcp:101: 00010000:00010000:0.0:1789498367.825322:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498367.825342:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80031a00/0x3a6cb1946bc181b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99f35 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498367.825372:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80031a00/0x3a6cb1946bc181b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f35 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498367.825404:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80031a00/0x3a6cb1946bc181b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f35 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498367.825415:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80031a00, rc 0) 00000100:00100000:0.0:1789498367.825518:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5600:x1876424864567936:12345-192.168.201.20@tcp:101: Request processed in 217us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498367.825525:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:1.0:1789498367.829341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498367.829406:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864568064 00000100:00100000:3.0:1789498367.829417:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864568064 00000100:00100000:3.0:1789498367.829487:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:3.0:1789498367.829500:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5600:x1876424864568064:12345-192.168.201.20@tcp:501: 00000100:00100000:3.0:1789498367.829853:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5600:x1876424864568064:12345-192.168.201.20@tcp:501: Request processed in 355us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498367.829862:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:2.0:1789498367.844762:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498367.845402:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864568192 00000100:00100000:1.0:1789498367.845415:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864568192 00000100:00100000:1.0:1789498367.845774:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:1.0:1789498367.845786:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5600:x1876424864568192:12345-192.168.201.20@tcp:503: 00000100:00100000:1.0:1789498367.846065:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5600:x1876424864568192:12345-192.168.201.20@tcp:503: Request processed in 281us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498367.846074:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:2.0:1789498367.859141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498367.859219:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864568320 00000100:00100000:0.0:1789498367.859230:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864568320 00000100:00100000:0.0:1789498367.859298:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:0.0:1789498367.859308:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:6068:x1876424864568320:12345-192.168.201.20@tcp:502: 00000100:00100000:0.0:1789498367.859862:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:6068:x1876424864568320:12345-192.168.201.20@tcp:502: Request processed in 553us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498367.859870:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:2.0:1789498367.865837:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498367.874424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864568448 00000100:00100000:1.0:1789498367.874443:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864568448 00000100:00100000:1.0:1789498367.874540:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:1.0:1789498367.874550:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:6068:x1876424864568448:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498367.874896:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:6068:x1876424864568448:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 345us (9069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498367.874905:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:2.0:1789498367.885462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498367.886467:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864568576 00000100:00100000:3.0:1789498367.886652:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864568576 00000100:00100000:3.0:1789498367.886800:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:3.0:1789498367.886811:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5600:x1876424864568576:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498367.886830:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498367.886848:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc181b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99f3c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498367.886881:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc181b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f3c expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498367.886893:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc181b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f3c expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498367.886904:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20da000, rc 0) 00000100:00100000:3.0:1789498367.887414:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5600:x1876424864568576:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 601us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498367.887423:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:2.0:1789498367.901781:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498367.902492:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864568704 00000100:00100000:0.0:1789498367.902509:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864568704 00000100:00100000:0.0:1789498367.902592:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:0.0:1789498367.902604:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5600:x1876424864568704:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498367.903126:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5600:x1876424864568704:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 520us (1350us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789498367.903135:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 138 00010000:00010000:0.0:1789498367.915519:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789498368.690900:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789498368.690913:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98ea891b9000 from 39 10000000:01000000:1.0:1789498368.690920:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789498368.690993:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.691020:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.691033:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498368.691114:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885563648:0@lo:101: 00000100:00100000:1.0:1789498368.691216:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498368.691286:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.691424:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885563648 00000100:00100000:2.0:1789498368.691444:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885563648 00000100:00100000:2.0:1789498368.691528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789498368.691540:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+12:5842:x1876424885563648:12345-0@lo:101: 00010000:00010000:2.0:1789498368.691560:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498368.691578:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc181bf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.691608:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc181bf expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.691621:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc181bf expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.691631:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554400, rc 0) 00000100:00100000:2.0:1789498368.691682:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885563648:12345-0@lo:101: Request processed in 145us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.691690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789498368.693644:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885563648:0@lo:101: 00010000:00010000:1.0:1789498368.693682:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.693699:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498368.693818:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885563776:0@lo:501: 00000100:00100000:1.0:1789498368.693887:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498368.693927:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.698615:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885563776 00000100:00100000:2.0:1789498368.698638:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885563776 00000100:00100000:2.0:1789498368.698769:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789498368.698782:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885563776:12345-0@lo:501: 00000100:00100000:2.0:1789498368.699308:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885563776:12345-0@lo:501: Request processed in 527us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.699318:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789498368.700291:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885563776:0@lo:501: 00000100:00100000:1.0:1789498368.700366:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885563904:0@lo:503: 00000100:00100000:1.0:1789498368.700454:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498368.700495:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498368.700519:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885563904 00000100:00100000:1.0:1789498368.700525:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885563904 00000100:00100000:1.0:1789498368.700572:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789498368.700583:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885563904:12345-0@lo:503: 00000100:00100000:1.0:1789498368.700813:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885563904:12345-0@lo:503: Request processed in 231us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498368.700821:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789498368.700871:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885563904:0@lo:503: 00000100:00100000:0.0:1789498368.703661:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8488:1876424885564032:0@lo:502: 00000100:00100000:0.0:1789498368.703769:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.703868:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea89b4b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.708369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885564032 00000100:00100000:2.0:1789498368.708781:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885564032 00000100:00100000:2.0:1789498368.708865:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789498368.708876:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:8488:x1876424885564032:12345-0@lo:502: 00000100:00100000:2.0:1789498368.709300:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:8488:x1876424885564032:12345-0@lo:502: Request processed in 425us (5530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.709309:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789498368.709651:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8488:1876424885564032:0@lo:502: 00000100:00100000:0.0:1789498368.709734:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8488:1876424885564160:0@lo:502: 00000100:00100000:0.0:1789498368.709780:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.709825:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea89b4b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.713385:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885564160 00000100:00100000:2.0:1789498368.713404:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885564160 00000100:00100000:0.0:1789498368.713646:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789498368.713658:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:8488:x1876424885564160:12345-0@lo:502: 00000100:00100000:0.0:1789498368.713986:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:8488:x1876424885564160:12345-0@lo:502: Request processed in 330us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.713994:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789498368.714300:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8488:1876424885564160:0@lo:502: 00000040:00080000:1.0:1789498368.714341:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789498368.714475:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789498368.714507:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789498368.714520:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.714533:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498368.714542:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789498368.714545:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789498368.714548:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789498368.714581:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.714589:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.714607:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498368.714627:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885564288:0@lo:101: 00000100:00100000:2.0:1789498368.714667:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.714700:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.715520:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885564288 00000100:00100000:0.0:1789498368.715528:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885564288 00000100:00100000:0.0:1789498368.715567:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789498368.715575:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+13:5842:x1876424885564288:12345-0@lo:101: 00010000:00010000:0.0:1789498368.715588:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498368.715616:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80031c00/0x3a6cb1946bc181d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc181cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.715644:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80031c00/0x3a6cb1946bc181d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc181cd expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.715655:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80031c00/0x3a6cb1946bc181d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc181cd expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.715665:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80031c00, rc 0) 00000100:00100000:0.0:1789498368.716555:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885564288:12345-0@lo:101: Request processed in 975us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.716565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789498368.716615:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885564288:0@lo:101: 00010000:00010000:2.0:1789498368.716637:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.716649:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498368.716718:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885564416:0@lo:501: 00000100:00100000:2.0:1789498368.716756:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.716794:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.719236:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885564416 00000100:00100000:0.0:1789498368.719252:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885564416 00000100:00100000:0.0:1789498368.719319:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789498368.719329:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885564416:12345-0@lo:501: 00000100:00100000:0.0:1789498368.719703:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885564416:12345-0@lo:501: Request processed in 375us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.719710:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789498368.720139:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885564416:0@lo:501: 00000100:00100000:2.0:1789498368.720198:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885564544:0@lo:503: 00000100:00100000:2.0:1789498368.720245:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.720285:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.720482:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885564544 00000100:00100000:0.0:1789498368.720487:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885564544 00000100:00100000:0.0:1789498368.720532:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789498368.720542:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885564544:12345-0@lo:503: 00000100:00100000:0.0:1789498368.720748:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885564544:12345-0@lo:503: Request processed in 207us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.720756:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789498368.721175:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885564544:0@lo:503: 00000100:00100000:1.0:1789498368.721747:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8489:1876424885564672:0@lo:502: 00000100:00100000:1.0:1789498368.721802:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498368.721840:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea89b4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.721982:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885564672 00000100:00100000:0.0:1789498368.721989:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885564672 00000100:00100000:0.0:1789498368.722032:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789498368.722041:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:8489:x1876424885564672:12345-0@lo:502: 00000100:00100000:0.0:1789498368.722279:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:8489:x1876424885564672:12345-0@lo:502: Request processed in 239us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.722287:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789498368.722340:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8489:1876424885564672:0@lo:502: 00000020:01000000:1.0:1789498368.722372:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498368.722382:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498368.722384:0:8489:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789498368.722389:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789498368.722411:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8489:1876424885564800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498368.722457:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498368.722490:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.722491:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885564800 00000100:00100000:2.0:1789498368.722508:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885564800 00000100:00100000:2.0:1789498368.722546:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789498368.722553:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:8489:x1876424885564800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498368.722696:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:8489:x1876424885564800:12345-0@lo:502:llog_process_th.0 Request processed in 143us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.722704:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789498368.722731:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8489:1876424885564800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498368.722755:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498368.722760:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498368.722761:0:8489:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789498368.722765:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789498368.722959:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789498368.722986:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789498368.722999:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.723011:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498368.723021:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789498368.723023:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98eabd51c800 from 39 10000000:01000000:2.0:1789498368.723026:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789498368.723054:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.723062:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.723071:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498368.723084:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885564928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.723149:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.723185:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498368.723256:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885564928 00000100:00100000:1.0:1789498368.723261:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885564928 00000100:00100000:1.0:1789498368.723288:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789498368.723297:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:5842:x1876424885564928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498368.723307:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498368.723322:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddfa00/0x3a6cb1946bc181e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc181db expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.723343:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddfa00/0x3a6cb1946bc181e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc181db expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.723363:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddfa00/0x3a6cb1946bc181e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc181db expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.723372:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddfa00, rc 0) 00000100:00100000:1.0:1789498368.723422:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885564928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498368.723427:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789498368.724363:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885564928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498368.724393:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498368.724417:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498368.724495:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.724534:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498368.724568:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.724580:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885565056 00000100:00100000:0.0:1789498368.724587:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885565056 00000100:00100000:0.0:1789498368.724621:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789498368.724630:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885565056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.724912:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885565056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.724928:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789498368.726355:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.726528:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.726623:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498368.726660:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.726723:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885565184 00000100:00100000:2.0:1789498368.726731:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885565184 00000100:00100000:2.0:1789498368.726789:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789498368.726804:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885565184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.726991:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885565184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.726999:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789498368.727616:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.728533:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8490:1876424885565312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498368.728605:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498368.728644:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.728793:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885565312 00000100:00100000:0.0:1789498368.728800:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885565312 00000100:00100000:0.0:1789498368.728837:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789498368.728846:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:8490:x1876424885565312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498368.729769:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:8490:x1876424885565312:12345-0@lo:502:llog_process_th.0 Request processed in 910us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.729779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789498368.729913:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8490:1876424885565312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498368.729980:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8490:1876424885565440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498368.730022:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498368.730075:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.730229:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885565440 00000100:00100000:0.0:1789498368.730235:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885565440 00000100:00100000:0.0:1789498368.730275:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789498368.730283:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:8490:x1876424885565440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498368.730486:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:8490:x1876424885565440:12345-0@lo:502:llog_process_th.0 Request processed in 203us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.730492:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789498368.730630:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8490:1876424885565440:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789498368.730657:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789498368.731173:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789498368.731202:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789498368.731228:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.731240:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498368.731251:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789498368.731254:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789498368.731257:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789498368.731291:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.731309:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.731322:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498368.731345:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.731396:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.731426:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.731455:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885565568 00000100:00100000:0.0:1789498368.731460:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885565568 00000100:00100000:0.0:1789498368.731499:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789498368.731509:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:5842:x1876424885565568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498368.731520:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498368.731534:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80030e00/0x3a6cb1946bc181f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc181e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.731564:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80030e00/0x3a6cb1946bc181f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc181e9 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.731578:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80030e00/0x3a6cb1946bc181f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc181e9 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.731587:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030e00, rc 0) 00000100:00100000:0.0:1789498368.731622:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885565568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.731628:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789498368.731668:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498368.731680:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.731691:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498368.731734:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.731770:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.731784:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.731794:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885565696 00000100:00100000:0.0:1789498368.731799:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885565696 00000100:00100000:0.0:1789498368.731816:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789498368.731821:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885565696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.732258:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885565696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.732267:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789498368.732313:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.732343:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.732384:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.732404:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.732416:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885565824 00000100:00100000:0.0:1789498368.732420:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885565824 00000100:00100000:0.0:1789498368.732453:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789498368.732460:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885565824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.732609:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885565824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.732623:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789498368.732659:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885565824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.733450:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8491:1876424885565952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498368.733622:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.733661:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.734773:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885565952 00000100:00100000:0.0:1789498368.734786:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885565952 00000100:00100000:0.0:1789498368.734838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789498368.734847:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:8491:x1876424885565952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498368.735130:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:8491:x1876424885565952:12345-0@lo:502:llog_process_th.0 Request processed in 282us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.735137:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789498368.735477:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8491:1876424885565952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498368.735525:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498368.735537:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498368.735540:0:8491:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789498368.735547:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789498368.735586:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8491:1876424885566080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498368.735643:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.735674:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885566080 00000100:00100000:2.0:1789498368.735678:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885566080 00000100:00100000:2.0:1789498368.735706:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789498368.735713:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:8491:x1876424885566080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498368.735864:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:8491:x1876424885566080:12345-0@lo:502:llog_process_th.0 Request processed in 151us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.735871:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789498368.735912:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09240 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.735923:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8491:1876424885566080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498368.735942:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498368.735946:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498368.735948:0:8491:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789498368.735951:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789498368.736811:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789498368.736836:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789498368.736847:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.736860:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498368.736871:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789498368.736874:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98ea90a2f000 from 39 10000000:01000000:0.0:1789498368.736876:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789498368.736906:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.736915:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.736923:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498368.737606:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.737662:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.737694:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.739853:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885566208 00000100:00100000:2.0:1789498368.739879:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885566208 00000100:00100000:2.0:1789498368.739931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789498368.739941:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885566208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498368.739957:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498368.739976:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554e00/0x3a6cb1946bc181fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc181f7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.740003:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554e00/0x3a6cb1946bc181fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc181f7 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.740015:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554e00/0x3a6cb1946bc181fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc181f7 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.740023:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554e00, rc 0) 00000100:00100000:2.0:1789498368.740129:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885566208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.740135:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789498368.740191:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498368.742342:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498368.742363:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498368.742473:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.742545:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.742597:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.742624:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885566336 00000100:00100000:2.0:1789498368.742644:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885566336 00000100:00100000:2.0:1789498368.742687:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789498368.742696:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885566336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.742995:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885566336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.743004:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789498368.743052:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.743086:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.743145:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.743161:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.743174:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885566464 00000100:00100000:2.0:1789498368.743178:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885566464 00000100:00100000:2.0:1789498368.743199:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789498368.743205:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885566464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.747467:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885566464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4253us (4313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.747481:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789498368.747564:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.767151:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8492:1876424885566592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498368.767309:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.767360:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498368.767381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885566592 00000100:00100000:3.0:1789498368.767395:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885566592 00000100:00100000:3.0:1789498368.767450:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789498368.767459:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:8492:x1876424885566592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498368.767717:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:8492:x1876424885566592:12345-0@lo:502:llog_process_th.0 Request processed in 259us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498368.767725:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789498368.768135:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8492:1876424885566592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498368.768277:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8492:1876424885566720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498368.768395:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498368.768421:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498368.768481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885566720 00000100:00100000:3.0:1789498368.768487:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885566720 00000100:00100000:3.0:1789498368.768526:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789498368.768533:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:8492:x1876424885566720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498368.768726:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:8492:x1876424885566720:12345-0@lo:502:llog_process_th.0 Request processed in 193us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498368.768733:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789498368.769111:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8492:1876424885566720:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789498368.769140:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789498368.769449:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789498368.769471:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789498368.769481:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498368.769492:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498368.769502:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789498368.769504:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789498368.769507:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789498368.769533:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498368.769541:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498368.769557:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498368.769574:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.769611:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498368.769636:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498368.769668:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885566848 00000100:00100000:1.0:1789498368.769688:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885566848 00000100:00100000:1.0:1789498368.769724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789498368.769731:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885566848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498368.769743:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498368.769758:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc1820c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18205 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.769782:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc1820c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18205 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.769792:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc1820c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18205 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.769806:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf800, rc 0) 00000100:00100000:1.0:1789498368.769845:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885566848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498368.769851:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789498368.769889:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498368.769901:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498368.769910:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498368.769955:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498368.769982:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498368.769995:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498368.770007:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885566976 00000100:00100000:1.0:1789498368.770010:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885566976 00000100:00100000:1.0:1789498368.770028:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789498368.770034:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885566976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498368.771069:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885566976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1028us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498368.771080:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789498368.771109:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885566976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.771155:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885567104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.771210:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498368.771403:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498368.772335:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885567104 00000100:00100000:2.0:1789498368.772347:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885567104 00000100:00100000:2.0:1789498368.772408:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789498368.772418:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885567104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498368.772650:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885567104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498368.772658:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789498368.773480:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885567104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498368.775509:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8493:1876424885567232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498368.777069:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.777139:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789498368.777526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885567232 00000100:00100000:3.0:1789498368.777536:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885567232 00000100:00100000:3.0:1789498368.777607:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789498368.777619:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:8493:x1876424885567232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498368.777909:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:8493:x1876424885567232:12345-0@lo:502:llog_process_th.0 Request processed in 291us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498368.777917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789498368.778248:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8493:1876424885567232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498368.778290:0:8493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498368.778301:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498368.778304:0:8493:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789498368.778312:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789498368.778351:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8493:1876424885567360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498368.778401:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498368.778768:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.779951:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885567360 00000100:00100000:0.0:1789498368.779966:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885567360 00000100:00100000:0.0:1789498368.780645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789498368.780662:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:8493:x1876424885567360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498368.781505:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:8493:x1876424885567360:12345-0@lo:502:llog_process_th.0 Request processed in 844us (3100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.781517:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789498368.782644:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8493:1876424885567360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498368.782697:0:8493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498368.782706:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498368.782708:0:8493:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789498368.782713:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789498368.783667:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789498368.783695:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789498368.783720:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.783734:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498368.783747:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789498368.783749:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98ea83f28000 from 1 10000000:01000000:0.0:1789498368.783752:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789498368.783805:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.783813:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.783831:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498368.783857:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885567488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.783916:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.784501:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.784525:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885567488 00000100:00100000:0.0:1789498368.784533:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885567488 00000100:00100000:0.0:1789498368.784583:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789498368.784594:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885567488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498368.784611:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498368.784627:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc1821a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18213 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.784655:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc1821a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18213 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.784667:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc1821a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18213 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.784676:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80031400, rc 0) 00000100:00100000:0.0:1789498368.784721:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885567488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498368.784729:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789498368.784768:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885567488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498368.784783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1821a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.784802:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1821a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498368.784862:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885567616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.784892:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498368.784908:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498368.785457:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885567616 00000100:00100000:0.0:1789498368.785463:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885567616 00000100:00100000:0.0:1789498368.785496:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789498368.785505:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885567616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498368.785780:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885567616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (887us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789498368.785788:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789498368.786330:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885567616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789498368.786362:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789498368.786371:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1821a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498368.786383:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1821a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498368.939244:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789498369.092931:0:8518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff44d9d110 20000000:00000080:0.0:1789498369.092954:0:8518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e985b6e400 uarg=0000000000000000 20000000:01000000:0.0:1789498369.093000:0:8518:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789498369.093006:0:8518:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789498369.093012:0:8518:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789498369.094460:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789498369.094647:0:8518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789498369.098853:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789498369.098987:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789498369.099044:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789498369.099060:0:8518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789498369.099079:0:8518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099297:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc17f96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099307:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099313:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099323:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099330:0:8518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099368:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099383:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 9 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498369.099409:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876424885567744:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498369.099528:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099546:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 18 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498369.099556:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876424885567872:0@lo:104: 00000100:00100000:0.0:1789498369.099596:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498369.099628:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099636:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 18 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498369.099644:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876424885568000:0@lo:104: 00000100:00100000:0.0:1789498369.099666:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498369.099688:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc17f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498369.099695:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc17f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 18 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498369.099703:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876424885568128:0@lo:104: 00000100:00100000:0.0:1789498369.099721:0:8518:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498369.099890:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789498369.099907:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498369.099924:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885567872 00000100:00100000:2.0:1789498369.099931:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885567872 00000100:00100000:2.0:1789498369.099972:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885568000 00000100:00100000:2.0:1789498369.099975:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885568000 00000100:00100000:2.0:1789498369.099983:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885568128 00000100:00100000:2.0:1789498369.099985:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885568128 00000100:00100000:2.0:1789498369.099996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498369.100004:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:8518:x1876424885567872:12345-0@lo:104: 00010000:00010000:2.0:1789498369.100016:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100108:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498369.100115:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+5:8518:x1876424885567872:12345-0@lo:104: Request processed in 112us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498369.100122:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498369.100138:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498369.100144:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:8518:x1876424885568000:12345-0@lo:104: 00010000:00010000:2.0:1789498369.100152:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100183:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789498369.100188:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:8518:x1876424885568000:12345-0@lo:104: Request processed in 45us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498369.100194:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498369.100223:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498369.100229:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:8518:x1876424885568128:12345-0@lo:104: 00010000:00010000:2.0:1789498369.100237:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100261:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789498369.100267:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:8518:x1876424885568128:12345-0@lo:104: Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498369.100272:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789498369.100287:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789498369.100293:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100301:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498369.100311:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100319:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498369.100325:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498369.100330:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498369.100357:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100364:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498369.100384:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100391:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc180bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc180c3 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100405:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498369.100409:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100415:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab640e000 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498369.100418:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100443:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498369.100461:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498369.100466:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498369.100481:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100487:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498369.100503:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100510:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab640e000/0x3a6cb1946bc17ff1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17ff8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100521:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498369.100525:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100531:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498369.100534:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100541:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498369.100548:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498369.100554:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498369.100574:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100580:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498369.100586:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100592:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc17f8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc17f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100605:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498369.100607:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498369.100609:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498369.100615:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498369.100626:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885568256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498369.100657:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498369.100692:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885568384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498369.100715:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498369.100732:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498369.100737:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885568512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498369.100758:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498369.100787:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885568256 00000100:00100000:2.0:1789498369.100791:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885568256 00010000:00010000:2.0:1789498369.100812:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 19 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498369.100828:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885568384 00000100:00100000:2.0:1789498369.100831:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885568384 00010000:00010000:2.0:1789498369.100841:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 20 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498369.100865:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885568512 00000100:00100000:2.0:1789498369.100868:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885568512 00010000:00010000:2.0:1789498369.100880:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc17f96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 21 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498369.100892:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498369.100899:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+21:3308:x1876424885568256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498369.100911:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498369.100916:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 21 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100926:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 21 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.100944:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498369.100970:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+21:3308:x1876424885568256:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498369.100976:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498369.100988:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498369.100993:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3305:x1876424885568384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498369.100999:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498369.101003:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 20 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.101011:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 20 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.101019:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498369.101044:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3305:x1876424885568384:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498369.101050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498369.101060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789498369.101065:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885568512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498369.101071:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498369.101075:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc17f96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 19 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.101083:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc17f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 19 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.101121:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498369.101138:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885568512:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498369.101143:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789498369.101182:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885568256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498369.101203:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885568512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498369.101209:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885568384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498369.101478:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc180c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc180bc expref: 18 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498369.101491:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876424885567872:0@lo:104: 00010000:00010000:0.0:1789498369.101501:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc17ff8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17ff1 expref: 17 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498369.101522:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876424885568000:0@lo:104: 00010000:00010000:0.0:1789498369.101534:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc17f96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc17f8f expref: 16 pid: 5837 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498369.101542:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876424885568128:0@lo:104: 00000100:00100000:1.0:1789498369.104130:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876424885567744:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498369.104171:0:8518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498369.105735:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498369.105806:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864568832 00000100:00100000:2.0:1789498369.105817:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864568832 00010000:00010000:2.0:1789498369.105862:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 10 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498369.105905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:2.0:1789498369.105914:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864568832:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498369.105928:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498369.105944:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 10 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.105957:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 10 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.105975:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc18180 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f04 expref: 10 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.105991:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.105999:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.106015:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.106022:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.106028:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.106034:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.106040:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80031600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498369.106043:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.106051:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498369.106467:0:8518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498369.106477:0:8518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.106986:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.106999:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80031600/0x3a6cb1946bc18221 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498369.107020:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498369.111605:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:2356:x1876424864568832:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 5679us (5867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498369.111618:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:2.0:1789498369.869577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498369.869667:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864568960 00000100:00100000:3.0:1789498369.869682:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864568960 00000100:00100000:3.0:1789498369.869759:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 171 00000100:00100000:3.0:1789498369.869793:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:5600:x1876424864568960:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498369.869819:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498369.869845:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99f43 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498369.869884:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498369.869898:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498369.869920:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db000, rc 0) 00000100:00100000:3.0:1789498369.869994:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5600:x1876424864568960:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 204us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498369.870003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 171 00000100:00100000:0.0:1789498369.872475:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498369.876983:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864569088 00000100:00100000:3.0:1789498369.877004:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864569088 00000100:00100000:3.0:1789498369.877081:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 172 00000100:00100000:3.0:1789498369.877109:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5600:x1876424864569088:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498369.877528:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5600:x1876424864569088:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 435us (5067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498369.877537:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 172 00000100:00100000:3.0:1789498369.880162:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498369.880272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864569216 00000100:00100000:0.0:1789498369.880285:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864569216 00000100:00100000:0.0:1789498369.880354:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 173 00000100:00100000:0.0:1789498369.880368:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5600:x1876424864569216:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498369.880691:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:5600:x1876424864569216:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 325us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498369.880701:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 173 00000100:00100000:3.0:1789498369.885157:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498369.885285:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864569344 00000100:00100000:1.0:1789498369.885299:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864569344 00000100:00100000:1.0:1789498369.885370:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:1.0:1789498369.885383:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:6125:x1876424864569344:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498369.885738:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:6125:x1876424864569344:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 356us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498369.885747:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:0.0:1789498369.891775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498369.891933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864569472 00000100:00100000:3.0:1789498369.891947:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864569472 00000100:00100000:3.0:1789498369.892031:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 175 00000100:00100000:3.0:1789498369.892065:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:6125:x1876424864569472:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789498369.892748:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:6125:x1876424864569472:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 680us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498369.892759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 175 00010000:00010000:3.0:1789498369.970602:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498370.541118:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885568768:0@lo:400:kworker.0 00000100:00100000:2.0:1789498370.541135:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885568896:0@lo:400:kworker.0 00000100:00100000:3.0:1789498370.541209:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885568640:0@lo:400:kworker.0 00000100:00100000:2.0:1789498370.542126:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498370.542213:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498370.542222:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885569024:0@lo:400:kworker.0 00000100:00100000:2.0:1789498370.542257:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498370.542634:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885569024 00000100:00100000:1.0:1789498370.542647:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885569024 00000100:00100000:1.0:1789498370.542725:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498370.542736:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885569024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498370.542814:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885569024:12345-0@lo:400:kworker.0 Request processed in 79us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498370.542822:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789498370.542875:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaeec000 x1876424885569024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498370.544323:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885569024:0@lo:400:kworker.0 00000100:00100000:0.0:1789498370.545664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.545716:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885569280:0@lo:400:kworker.0 00000100:00100000:0.0:1789498370.545757:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.545821:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885569280 00000100:00100000:0.0:1789498370.545830:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885569280 00000100:00100000:0.0:1789498370.545897:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789498370.545907:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885569280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498370.545971:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885569280:12345-0@lo:400:kworker.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498370.545993:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789498370.546045:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaeef480 x1876424885569280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498370.546058:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885569280:0@lo:400:kworker.0 00000100:00100000:2.0:1789498370.547031:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885568896 00000100:00100000:2.0:1789498370.547041:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885568896 00000100:00100000:2.0:1789498370.547112:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885568768 00000100:00100000:2.0:1789498370.547116:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885568768 00000100:00100000:2.0:1789498370.547144:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789498370.547154:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885568896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498370.547224:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885568896:12345-0@lo:400:kworker.0 Request processed in 71us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498370.547232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789498370.547246:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498370.547253:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885568768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498370.547298:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885568768:12345-0@lo:400:kworker.0 Request processed in 46us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498370.547306:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789498370.547618:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885568896:0@lo:400:kworker.0 00000100:00080000:1.0:1789498370.547685:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498370.547697:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498370.547701:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498370.547976:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885568768:0@lo:400:kworker.0 00000100:00100000:1.0:1789498370.552196:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.552262:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885568640 00000100:00100000:1.0:1789498370.552266:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885569152:0@lo:400:kworker.0 00000100:00100000:0.0:1789498370.552274:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885568640 00000100:00100000:1.0:1789498370.552310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.552346:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789498370.552359:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3307:x1876424885568640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498370.552442:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885569152 00000100:00100000:2.0:1789498370.552448:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885569152 00000100:00100000:2.0:1789498370.552522:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789498370.552530:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885569152:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789498370.552556:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498370.552596:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885569152:12345-0@lo:400:kworker.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498370.552604:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498370.552658:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885569152:0@lo:400:kworker.0 00000100:00100000:1.0:1789498370.553269:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3307:x1876424885568640:12345-0@lo:400:kworker.0 Request processed in 910us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498370.553279:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789498370.553337:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885568640:0@lo:400:kworker.0 10000000:01000000:0.0:1789498370.670229:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789498370.670241:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea891b9000 from 4 10000000:01000000:0.0:1789498370.670249:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498370.670318:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498370.670334:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498370.670348:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498370.670384:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885569408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.670488:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.670559:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498370.670616:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885569408 00000100:00100000:3.0:1789498370.670626:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885569408 00000100:00100000:3.0:1789498370.670704:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789498370.670716:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885569408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498370.670735:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498370.670753:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1822f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.670781:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.670793:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.670803:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db800, rc 0) 00000100:00100000:3.0:1789498370.670857:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885569408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498370.670887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789498370.670982:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885569408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498370.670999:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498370.671014:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498370.671081:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885569536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.671136:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.671157:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498370.671205:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885569536 00000100:00100000:3.0:1789498370.671209:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885569536 00000100:00100000:3.0:1789498370.671237:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789498370.671244:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885569536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498370.671524:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885569536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498370.671531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789498370.671643:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885569536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.671674:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885569664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.671716:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.671738:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498370.671777:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885569664 00000100:00100000:3.0:1789498370.671782:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885569664 00000100:00100000:3.0:1789498370.671810:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789498370.671816:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885569664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498370.671997:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885569664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498370.672003:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789498370.672136:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885569664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.672558:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8553:1876424885569792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498370.672593:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.672615:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789498370.672651:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885569792 00000100:00100000:3.0:1789498370.672656:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885569792 00000100:00100000:3.0:1789498370.672682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789498370.672689:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:8553:x1876424885569792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498370.676646:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:8553:x1876424885569792:12345-0@lo:502:llog_process_th.0 Request processed in 3939us (4034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498370.676667:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789498370.680874:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeeea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8553:1876424885569792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498370.680949:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498370.681021:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498370.681025:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789498370.681034:0:8553:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98ea891b9000 00000020:00000080:1.0:1789498370.681038:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789498370.681311:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8553:1876424885569920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498370.681422:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498370.681518:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789498370.692540:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885569920 00000100:00100000:3.0:1789498370.692565:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885569920 00000100:00100000:3.0:1789498370.692652:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789498370.692664:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:8553:x1876424885569920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498370.693040:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:8553:x1876424885569920:12345-0@lo:502:llog_process_th.0 Request processed in 378us (11618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498370.693049:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789498370.697268:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8553:1876424885569920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498370.697331:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498370.697346:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498370.697350:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789498370.697355:0:8553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789498370.700584:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789498370.700635:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498370.700654:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.700670:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498370.700684:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498370.700688:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eabd51c800 from 4 10000000:01000000:3.0:1789498370.700692:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498370.700745:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.700754:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.700768:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498370.700804:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498370.700902:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498370.700959:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498370.705909:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885570048 00000100:00100000:0.0:1789498370.705925:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885570048 00000100:00100000:0.0:1789498370.705998:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789498370.706009:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885570048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498370.706028:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498370.706050:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1823d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498370.706080:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498370.706144:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498370.706153:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030000, rc 0) 00000100:00100000:0.0:1789498370.706235:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885570048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (5333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498370.706242:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789498370.706300:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498370.706317:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498370.706326:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498370.706965:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.707010:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.707053:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498370.707076:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885570176 00000100:00100000:0.0:1789498370.707081:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885570176 00000100:00100000:0.0:1789498370.707201:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789498370.707209:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885570176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.707849:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885570176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 640us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498370.707858:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789498370.707921:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498370.708010:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498370.708118:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498370.708269:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498370.708308:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885570304 00000100:00100000:2.0:1789498370.708315:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885570304 00000100:00100000:2.0:1789498370.708366:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789498370.708375:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885570304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498370.708620:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885570304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498370.708629:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789498370.708681:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498370.708944:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8558:1876424885570432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498370.708986:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498370.709023:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498370.709031:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885570432 00000100:00100000:0.0:1789498370.709042:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885570432 00000100:00100000:0.0:1789498370.709182:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789498370.709191:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:8558:x1876424885570432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498370.709360:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:8558:x1876424885570432:12345-0@lo:502:llog_process_th.0 Request processed in 171us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498370.709365:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789498370.709669:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8558:1876424885570432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498370.709700:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498370.709714:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498370.709717:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789498370.709726:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98eabd51c800 00000020:00000080:2.0:1789498370.709730:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789498370.709842:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8558:1876424885570560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498370.709892:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498370.709923:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498370.710207:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885570560 00000100:00100000:0.0:1789498370.710214:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885570560 00000100:00100000:0.0:1789498370.710242:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789498370.710247:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:8558:x1876424885570560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498370.710417:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:8558:x1876424885570560:12345-0@lo:502:llog_process_th.0 Request processed in 168us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498370.710434:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789498370.710904:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8558:1876424885570560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498370.710931:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498370.710938:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498370.710940:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789498370.710944:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789498370.711201:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789498370.711233:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498370.711244:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.711278:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498370.711293:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498370.711297:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea90a2f000 from 4 10000000:01000000:3.0:1789498370.711301:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498370.711454:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.711463:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.711472:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498370.711495:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498370.711545:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498370.711588:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789498370.712314:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885570688 00000100:00100000:2.0:1789498370.712326:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885570688 00000100:00100000:2.0:1789498370.712386:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789498370.712406:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea88529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885570688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498370.712425:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498370.712449:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1824b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498370.712486:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498370.712499:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498370.712523:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554800, rc 0) 00000100:00100000:2.0:1789498370.712602:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea88529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885570688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498370.712609:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789498370.712668:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498370.712689:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498370.712701:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498370.712785:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498370.712821:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498370.712867:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498370.712989:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885570816 00000100:00100000:0.0:1789498370.713002:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885570816 00000100:00100000:0.0:1789498370.713062:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789498370.713072:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885570816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.713894:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885570816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 819us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498370.713904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789498370.718154:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498370.718241:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498370.718317:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498370.718355:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498370.718529:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885570944 00000100:00100000:3.0:1789498370.718538:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885570944 00000100:00100000:3.0:1789498370.719057:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789498370.719070:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885570944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498370.719371:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885570944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 303us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498370.719468:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789498370.719546:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885570944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498370.733056:0:8559:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8559:1876424885571072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498370.733210:0:8559:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.733269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885571072 00000100:00100000:0.0:1789498370.733278:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885571072 00000100:00100000:0.0:1789498370.733343:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789498370.733358:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea88528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:8559:x1876424885571072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498370.733681:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea88528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:8559:x1876424885571072:12345-0@lo:502:llog_process_th.0 Request processed in 326us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498370.733697:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789498370.733765:0:8559:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498370.733793:0:8559:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8559:1876424885571072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789498370.733832:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498370.733844:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498370.733847:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789498370.733855:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98ea90a2f000 00000020:00000080:0.0:1789498370.733858:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789498370.733956:0:8559:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8559:1876424885571200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498370.733998:0:8559:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498370.734018:0:8559:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea857419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498370.734232:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885571200 00000100:00100000:0.0:1789498370.734238:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885571200 00000100:00100000:0.0:1789498370.734273:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789498370.734281:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:8559:x1876424885571200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498370.734782:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:8559:x1876424885571200:12345-0@lo:502:llog_process_th.0 Request processed in 501us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498370.734790:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789498370.734834:0:8559:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:8559:1876424885571200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789498370.734856:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498370.734861:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498370.734863:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789498370.734868:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789498370.735185:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789498370.735233:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498370.735246:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498370.735262:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498370.989508:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498371.058754:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498371.058780:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885571328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498371.058857:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498371.058931:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885571328 00000100:00100000:2.0:1789498371.058941:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885571328 00000100:00100000:2.0:1789498371.058994:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498371.059003:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885571328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498371.059040:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498371.059081:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885571328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498371.059128:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789498371.059170:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9910e00 x1876424885571328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498371.059187:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885571328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498371.060771:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885571456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498371.060826:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498371.060912:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885571456 00000100:00100000:1.0:1789498371.060920:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885571456 00000100:00100000:1.0:1789498371.060964:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789498371.060971:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885571456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498371.061001:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498371.061043:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885571456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498371.061061:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789498371.061145:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fa8a80 x1876424885571456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498371.061163:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885571456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498372.017056:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498372.502315:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498372.502375:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498372.502476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498372.502571:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864569600 00000100:00100000:0.0:1789498372.502585:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864569600 00000100:00100000:3.0:1789498372.502914:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498372.502968:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864569728 00000100:00100000:2.0:1789498372.502973:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864569728 00000100:00100000:2.0:1789498372.503028:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:0.0:1789498372.503028:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 192 00000100:00100000:2.0:1789498372.503039:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864569728:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498372.503039:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2358:x1876424864569600:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498372.503147:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2358:x1876424864569600:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 110us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498372.503155:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 192 00000100:00100000:2.0:1789498372.506682:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864569728:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 3632us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498372.506698:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00080000:2.0:1789498372.507010:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498372.520634:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864569856 00000100:00100000:1.0:1789498372.520651:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864569856 00000100:00100000:1.0:1789498372.521110:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864569984 00000100:00100000:1.0:1789498372.521115:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864569984 00000100:00100000:3.0:1789498372.524693:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498372.524723:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864569856:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498372.524836:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864569856:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 128us (22471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498372.524845:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00080000:2.0:1789498372.525618:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498372.525627:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498372.526358:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:1.0:1789498372.526386:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864569984:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498372.526466:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864569984:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 97us (23552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498372.526473:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00010000:00010000:2.0:1789498373.041368:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498374.060879:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498375.085292:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498375.659476:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885571712:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.659548:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498375.659609:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885572224:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.659634:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498375.659668:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789498375.659674:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885571584:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.659703:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498375.659721:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885572096:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.659740:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498375.659766:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885571840:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.659804:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498375.659826:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498375.659831:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885571968:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.659853:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498375.659884:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885571712 00000100:00100000:1.0:1789498375.659898:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885571712 00000100:00100000:1.0:1789498375.659941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885572096 00000100:00100000:1.0:1789498375.659944:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885572096 00000100:00100000:1.0:1789498375.659965:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885571840 00000100:00100000:1.0:1789498375.659967:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885571840 00000100:00100000:1.0:1789498375.659982:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498375.659990:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885571712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.660042:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885571712:12345-0@lo:400:kworker.0 Request processed in 53us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498375.660049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498375.660067:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789498375.660073:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885572096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.660283:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885572096:12345-0@lo:400:kworker.0 Request processed in 209us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498375.660290:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789498375.660303:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498375.660321:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885571840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.660354:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885571840:12345-0@lo:400:kworker.0 Request processed in 45us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498375.660360:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498375.660377:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885572224 00000100:00100000:1.0:1789498375.660381:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885572224 00000100:00100000:1.0:1789498375.660405:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885571968 00000100:00100000:1.0:1789498375.660407:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885571968 00000100:00100000:1.0:1789498375.660420:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789498375.660426:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885572224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.660454:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885572224:12345-0@lo:400:kworker.0 Request processed in 29us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498375.660470:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789498375.660482:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789498375.660487:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885571968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.660514:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885571968:12345-0@lo:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498375.660519:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789498375.660544:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498375.660549:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498375.660551:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789498375.660580:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fab100 x1876424885571968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498375.660595:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885571968:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.660605:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885571840:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.660636:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885572096:0@lo:400:kworker.0 00000100:00100000:1.0:1789498375.660644:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885571712:0@lo:400:kworker.0 00010000:00080000:1.0:1789498375.660661:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9faad80 x1876424885572224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498375.660668:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885572224:0@lo:400:kworker.0 00000100:00100000:0.0:1789498375.660767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885571584 00000100:00100000:0.0:1789498375.660771:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885571584 00000100:00100000:0.0:1789498375.660810:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789498375.660818:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885571584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498375.660858:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885571584:12345-0@lo:400:kworker.0 Request processed in 41us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498375.660865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789498375.660899:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885571584:0@lo:400:kworker.0 00010000:00010000:0.0:1789498376.109886:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498376.171229:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498376.171254:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885572352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498376.171347:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498376.171431:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885572352 00000100:00100000:3.0:1789498376.171440:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885572352 00000100:00100000:3.0:1789498376.171489:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498376.171498:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885572352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498376.171536:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885572480:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498376.171553:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498376.171563:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498376.171613:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885572352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498376.171627:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789498376.171629:0:6706:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789498376.171637:0:6706:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789498376.171641:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885572480 00000100:00100000:3.0:1789498376.171644:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885572480 00000100:00100000:3.0:1789498376.171659:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498376.171663:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885572480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498376.171682:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498376.171710:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885572480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498376.171715:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789498376.172107:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cf8e00 x1876424885572480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498376.172128:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885572480:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789498376.172150:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb3e8700 x1876424885572352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498376.172162:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885572352:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789498376.927936:0:8819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789498377.139079:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498377.620177:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498377.620218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498377.620243:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498377.620265:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498377.622051:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864570368 00000100:00100000:2.0:1789498377.622067:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864570368 00000100:00100000:2.0:1789498377.622147:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864570496 00000100:00100000:2.0:1789498377.622151:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864570496 00000100:00100000:2.0:1789498377.622178:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1789498377.622188:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864570368:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498377.622283:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864570368:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498377.622292:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1789498377.622310:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498377.622317:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864570496:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498377.622358:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864570496:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 42us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498377.622365:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498377.622385:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864570240 00000100:00100000:2.0:1789498377.622388:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864570240 00000100:00100000:2.0:1789498377.622415:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1789498377.622421:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864570240:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498377.622447:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864570240:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498377.622454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00080000:1.0:1789498377.625248:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498377.625258:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498377.625261:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498377.630167:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864570112 00000100:00100000:0.0:1789498377.630183:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864570112 00000100:00100000:0.0:1789498377.630237:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 194 00000100:00100000:0.0:1789498377.630247:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864570112:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498377.630340:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864570112:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 94us (10172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498377.630355:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 194 00010000:00010000:3.0:1789498378.156015:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498379.180320:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498380.203206:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498380.779301:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885572736:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.779372:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498380.779435:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885573248:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.779463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498380.779512:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789498380.779520:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885572608:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.779550:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498380.779571:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885573120:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.779592:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498380.779617:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885572864:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.779640:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498380.779660:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498380.779665:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885572992:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.779685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498380.779718:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885572736 00000100:00100000:1.0:1789498380.779726:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885572736 00000100:00100000:1.0:1789498380.779770:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885573120 00000100:00100000:1.0:1789498380.779773:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885573120 00000100:00100000:1.0:1789498380.779793:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885572864 00000100:00100000:1.0:1789498380.779807:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885572864 00000100:00100000:1.0:1789498380.779828:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789498380.779836:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885572736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.779892:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885572736:12345-0@lo:400:kworker.0 Request processed in 56us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498380.779899:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789498380.779918:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789498380.779924:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885573120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.779951:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885573120:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498380.779957:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789498380.779968:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789498380.779974:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885572864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.780003:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885572864:12345-0@lo:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498380.780010:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789498380.780028:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885573248 00000100:00100000:1.0:1789498380.780031:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885573248 00000100:00100000:1.0:1789498380.780058:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885572992 00000100:00100000:1.0:1789498380.780061:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885572992 00000100:00100000:1.0:1789498380.780073:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498380.780079:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885573248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.780137:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885573248:12345-0@lo:400:kworker.0 Request processed in 59us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498380.780143:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498380.780154:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498380.780160:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885572992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.780197:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885572992:12345-0@lo:400:kworker.0 Request processed in 37us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498380.780202:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498380.780232:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885572608 00000100:00100000:1.0:1789498380.780235:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885572608 00000100:00100000:1.0:1789498380.780260:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789498380.780266:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885572608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.780294:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885572608:12345-0@lo:400:kworker.0 Request processed in 29us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498380.780300:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1789498380.780338:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498380.780343:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498380.780345:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789498380.780378:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cf9f80 x1876424885572992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498380.780392:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885572992:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.780402:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885572864:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.780430:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885572608:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.780439:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885573120:0@lo:400:kworker.0 00000100:00100000:1.0:1789498380.780448:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885572736:0@lo:400:kworker.0 00010000:00080000:1.0:1789498380.780457:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cfa300 x1876424885573248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498380.780464:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885573248:0@lo:400:kworker.0 00010000:00010000:2.0:1789498381.227832:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498381.293130:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498381.293195:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885573376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498381.293339:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498381.293449:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885573376 00000100:00100000:1.0:1789498381.293457:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885573376 00000100:00100000:1.0:1789498381.293549:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789498381.293558:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885573376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498381.293596:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498381.293638:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885573376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498381.293646:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789498381.293683:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cfa300 x1876424885573376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498381.293701:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885573376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498381.294077:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498381.294102:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885573504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498381.294135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498381.294234:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885573504 00000100:00100000:2.0:1789498381.294240:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885573504 00000100:00100000:2.0:1789498381.294277:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498381.294285:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885573504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498381.294310:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498381.294353:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885573504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498381.294359:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789498381.294389:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb3ebb80 x1876424885573504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498381.294403:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885573504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789498382.251241:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498382.740664:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498382.740704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498382.740747:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864570624 00000100:00100000:0.0:1789498382.740757:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864570624 00000100:00100000:0.0:1789498382.740820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 196 00000100:00100000:0.0:1789498382.740830:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864570624:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498382.740910:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864570624:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498382.740918:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 196 00000100:00100000:0.0:1789498382.740952:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864570752 00000100:00100000:0.0:1789498382.740956:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864570752 00000100:00100000:0.0:1789498382.742156:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:0.0:1789498382.742169:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864570752:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498382.742298:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864570752:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 131us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498382.742306:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00080000:0.0:1789498382.742332:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498382.748592:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498382.749153:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498382.756892:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864570880 00000100:00100000:1.0:1789498382.756908:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864570880 00000100:00100000:1.0:1789498382.756971:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864571008 00000100:00100000:1.0:1789498382.756975:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864571008 00000100:00100000:3.0:1789498382.757111:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:3.0:1789498382.757124:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2354:x1876424864570880:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1789498382.757162:0:6701:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1818e 00000100:00080000:3.0:1789498382.757173:0:6701:0:(import.c:65:import_set_state_nolock()) ffff98ea89103000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498382.757226:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1789498382.757570:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498382.757575:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789498382.758245:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498382.759115:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+2:2354:x1876424864570880:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 1987us (10526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498382.759138:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:3.0:1789498382.759170:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:3.0:1789498382.759603:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2354:x1876424864571008:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1789498382.759639:0:6701:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18195 00000100:00080000:3.0:1789498382.759653:0:6701:0:(import.c:65:import_set_state_nolock()) ffff98ea89106800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498382.759697:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789498382.762105:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498382.765344:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+2:2354:x1876424864571008:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 4283us (14309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498382.765372:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000001:02000400:2.0:1789498382.848849:0:9063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing yml_node 00000001:00100000:3.0:1789498382.875851:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:3.0:1789498382.875861:0:6726:0:(genops.c:885:class_export_put()) final put ffff98ea89105800/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:3.0:1789498382.875887:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea89105800/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c for lustre-OST0000 00000020:00000080:3.0:1789498382.875931:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea89103000 for lustre-OST0000 00010000:00010000:1.0:1789498383.279795:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498384.310462:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498385.324517:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498385.901119:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885573888:0@lo:400:kworker.0 00000100:00100000:0.0:1789498385.901203:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498385.901320:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885573632:0@lo:400:kworker.0 00000100:00100000:2.0:1789498385.901372:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498385.901405:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498385.901410:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885573760:0@lo:400:kworker.0 00000100:00100000:2.0:1789498385.901447:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498385.902515:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885574016:0@lo:400:kworker.0 00000100:00100000:2.0:1789498385.902561:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498385.902667:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885573888 00000100:00100000:1.0:1789498385.902675:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885573888 00000100:00100000:1.0:1789498385.902923:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885573760 00000100:00100000:1.0:1789498385.902927:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885573760 00000100:00100000:1.0:1789498385.902966:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789498385.902973:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885573888:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789498385.903048:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498385.903079:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885574016 00000100:00100000:2.0:1789498385.903084:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885574016 00000100:00100000:2.0:1789498385.903146:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789498385.903154:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885574016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498385.903194:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885574016:12345-0@lo:400:kworker.0 Request processed in 41us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498385.903208:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789498385.903231:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789498385.903240:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885573760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498385.903276:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885573760:12345-0@lo:400:kworker.0 Request processed in 38us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498385.903282:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789498385.903300:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885573632 00000100:00100000:2.0:1789498385.903303:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885573632 00000100:00100000:2.0:1789498385.903327:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789498385.903333:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885573632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498385.903362:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885573632:12345-0@lo:400:kworker.0 Request processed in 30us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498385.903367:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1789498385.903391:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789498385.903418:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea8535dc00 x1876424885574016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498385.903447:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885574016:0@lo:400:kworker.0 00000100:00100000:2.0:1789498385.903480:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885573760:0@lo:400:kworker.0 00000100:00100000:2.0:1789498385.903490:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885573632:0@lo:400:kworker.0 00000100:00100000:3.0:1789498385.906349:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885574272:0@lo:400:kworker.0 00000100:00100000:3.0:1789498385.906420:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498385.906468:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498385.906475:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885574144:0@lo:400:kworker.0 00000100:00100000:3.0:1789498385.906500:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498385.906534:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885574272 00000100:00100000:3.0:1789498385.906542:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885574272 00000100:00100000:3.0:1789498385.906598:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498385.906606:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885574272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498385.907168:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885574272:12345-0@lo:400:kworker.0 Request processed in 560us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498385.907194:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789498385.907223:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498385.907235:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885574144 00000100:00100000:3.0:1789498385.907239:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885574144 00000100:00100000:3.0:1789498385.907273:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789498385.907279:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885574144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498385.907510:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885574144:12345-0@lo:400:kworker.0 Request processed in 230us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498385.907516:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789498385.907535:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498385.907570:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885574144:0@lo:400:kworker.0 00010000:00080000:3.0:1789498385.907584:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea8535ea00 x1876424885574272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498385.907595:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885574272:0@lo:400:kworker.0 00000100:00100000:1.0:1789498385.907737:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885573888:12345-0@lo:400:kworker.0 Request processed in 4762us (6531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498385.907746:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789498385.908473:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885573888:0@lo:400:kworker.0 00010000:00010000:1.0:1789498386.348696:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498386.411418:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885574400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498386.411519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498386.411673:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885574400 00000100:00100000:2.0:1789498386.411687:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885574400 00000100:00100000:2.0:1789498386.411762:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498386.411774:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885574400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498386.411826:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498386.411898:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885574400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498386.411906:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789498386.413309:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabae8f480 x1876424885574400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498386.413347:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885574400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498386.414110:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498386.414133:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885574528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498386.414202:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498386.414304:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885574528 00000100:00100000:3.0:1789498386.414313:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885574528 00000100:00100000:3.0:1789498386.414364:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498386.414375:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885574528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498386.414420:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498386.414477:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885574528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (274us total) trans 0 rc 0/0 00010000:00080000:1.0:1789498386.414528:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea8535ea00 x1876424885574528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498386.414544:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885574528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498386.422491:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000001:02000400:0.0:1789498387.109926:0:9256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1789498387.372277:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789498387.500138:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:2.0:1789498387.500152:0:7653:0:(genops.c:885:class_export_put()) final put ffff98ea89101000/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:2.0:1789498387.500193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea89101000/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c for lustre-OST0001 00000020:00000080:2.0:1789498387.500292:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea89106800 for lustre-OST0001 00000100:00100000:0.0:1789498387.857890:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498387.859115:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498387.859478:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864571136 00000100:00100000:1.0:1789498387.859492:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864571136 00000100:00100000:1.0:1789498387.859559:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 198 00000100:00100000:1.0:1789498387.859571:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2355:x1876424864571136:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498387.859875:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2355:x1876424864571136:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 305us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498387.859885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 198 00000100:00100000:2.0:1789498387.860436:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864571264 00000100:00100000:2.0:1789498387.860446:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864571264 00000100:00100000:2.0:1789498387.860517:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:2.0:1789498387.860527:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864571264:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:1.0:1789498387.860653:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498387.860674:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864571264:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 52us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498387.860684:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00010000:00010000:1.0:1789498388.395323:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498389.430918:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789498390.072018:0:9353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1789498390.450650:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498391.020507:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885574912:0@lo:400:kworker.0 00000100:00100000:0.0:1789498391.020758:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498391.020839:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498391.020846:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885575040:0@lo:400:kworker.0 00000100:00100000:0.0:1789498391.020890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498391.020934:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885574912 00000100:00100000:0.0:1789498391.020944:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885574912 00000100:00100000:0.0:1789498391.021018:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789498391.021031:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885574912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498391.021155:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885574912:12345-0@lo:400:kworker.0 Request processed in 127us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498391.021164:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789498391.021191:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498391.021234:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885574912:0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.021497:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885574656:0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.021549:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498391.021575:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885575168:0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.021599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498391.021638:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789498391.021645:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885574784:0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.021669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498391.021688:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885575296:0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.021713:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498391.021755:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885575040 00000100:00100000:2.0:1789498391.021760:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885575040 00000100:00100000:2.0:1789498391.021800:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885575296 00000100:00100000:2.0:1789498391.021814:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885575296 00000100:00100000:2.0:1789498391.021834:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789498391.021839:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885575040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.021885:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885575040:12345-0@lo:400:kworker.0 Request processed in 45us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498391.021892:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789498391.021906:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789498391.021911:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885575296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.021942:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885575296:12345-0@lo:400:kworker.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498391.021948:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789498391.021966:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885575168 00000100:00100000:2.0:1789498391.021969:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885575168 00000100:00100000:2.0:1789498391.021992:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885574784 00000100:00100000:2.0:1789498391.021995:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885574784 00000100:00100000:2.0:1789498391.022012:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789498391.022019:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885575168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.022064:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885575168:12345-0@lo:400:kworker.0 Request processed in 44us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498391.022070:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789498391.022081:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789498391.022087:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885574784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.022143:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885574784:12345-0@lo:400:kworker.0 Request processed in 56us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498391.022150:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789498391.022183:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498391.022188:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498391.022197:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498391.022229:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885574784:0@lo:400:kworker.0 00010000:00080000:2.0:1789498391.022244:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8df80 x1876424885575296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498391.022254:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885575296:0@lo:400:kworker.0 00000100:00100000:2.0:1789498391.022263:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885575168:0@lo:400:kworker.0 00010000:00080000:2.0:1789498391.022303:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaeec000 x1876424885575040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498391.022313:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885575040:0@lo:400:kworker.0 00000100:00100000:0.0:1789498391.023468:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885574656 00000100:00100000:0.0:1789498391.023481:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885574656 00000100:00100000:0.0:1789498391.023791:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789498391.023804:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885574656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498391.023899:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885574656:12345-0@lo:400:kworker.0 Request processed in 99us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498391.023908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789498391.024818:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885574656:0@lo:400:kworker.0 00010000:00010000:1.0:1789498391.474222:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498391.539641:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885575424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498391.539754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498391.539885:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885575424 00000100:00100000:3.0:1789498391.539896:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885575424 00000100:00100000:3.0:1789498391.539962:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498391.539973:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885575424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498391.540045:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498391.540121:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885575424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498391.540130:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789498391.540180:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea8535f800 x1876424885575424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498391.540201:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885575424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498391.548191:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885575552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498391.548312:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498391.552614:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885575552 00000100:00100000:0.0:1789498391.552635:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885575552 00000100:00100000:0.0:1789498391.552710:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789498391.552722:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885575552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498391.552780:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498391.552879:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885575552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (4567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498391.552887:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789498391.556947:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8ed80 x1876424885575552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498391.556988:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885575552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789498392.491572:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498392.979962:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498392.980039:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498392.980080:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864571392 00000100:00100000:3.0:1789498392.980108:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864571392 00000100:00100000:3.0:1789498392.980171:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 200 00000100:00100000:3.0:1789498392.980182:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2355:x1876424864571392:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498392.980267:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2355:x1876424864571392:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498392.980275:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 200 00000100:00100000:1.0:1789498392.981284:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864571520 00000100:00100000:1.0:1789498392.981299:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864571520 00000100:00100000:1.0:1789498392.981371:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:1.0:1789498392.981381:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864571520:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498392.981449:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864571520:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 70us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498392.981457:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00080000:3.0:1789498392.982719:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789498393.344839:0:9453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:1.0:1789498393.516469:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498394.539308:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789498395.418867:0:9501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 14:53:13 EDT 2026 00010000:00010000:1.0:1789498395.563321:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498396.140652:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885576064:0@lo:400:kworker.0 00000100:00100000:1.0:1789498396.140765:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498396.140861:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498396.140869:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885575936:0@lo:400:kworker.0 00000100:00100000:1.0:1789498396.140899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498396.140950:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885576064 00000100:00100000:1.0:1789498396.140962:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885576064 00000100:00100000:1.0:1789498396.141043:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498396.141054:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885576064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498396.141166:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885576064:12345-0@lo:400:kworker.0 Request processed in 114us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498396.141175:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498396.141206:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885575936 00000100:00100000:1.0:1789498396.141210:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885575936 00000100:00100000:1.0:1789498396.141246:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789498396.141410:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498396.141418:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789498396.141460:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cf9f80 x1876424885576064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498396.141480:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885576064:0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.141741:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885575808:0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.141785:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498396.141817:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885576320:0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.141839:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498396.141866:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789498396.141872:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885575680:0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.141901:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498396.141924:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885576192:0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.141958:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498396.141987:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885576320 00000100:00100000:3.0:1789498396.141992:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885576320 00000100:00100000:3.0:1789498396.142033:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498396.142040:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885576320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.142122:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885576320:12345-0@lo:400:kworker.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498396.142129:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498396.142152:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885575680 00000100:00100000:3.0:1789498396.142155:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885575680 00000100:00100000:3.0:1789498396.142183:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789498396.142190:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885575680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.142223:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885575680:12345-0@lo:400:kworker.0 Request processed in 34us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498396.142230:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789498396.142256:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885575808 00000100:00100000:3.0:1789498396.142384:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885575808 00000100:00100000:3.0:1789498396.142409:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885576192 00000100:00100000:3.0:1789498396.142412:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885576192 00000100:00100000:3.0:1789498396.142497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789498396.142506:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885575808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.142541:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885575808:12345-0@lo:400:kworker.0 Request processed in 37us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498396.142547:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789498396.142560:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789498396.142566:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885576192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.142593:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885576192:12345-0@lo:400:kworker.0 Request processed in 28us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498396.142599:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789498396.142641:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885575680:0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.142654:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885576192:0@lo:400:kworker.0 00000100:00100000:3.0:1789498396.142663:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885575808:0@lo:400:kworker.0 00010000:00080000:3.0:1789498396.142675:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cf8a80 x1876424885576320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498396.142687:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885576320:0@lo:400:kworker.0 00000100:00080000:0.0:1789498396.143201:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498396.143207:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498396.152838:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885575936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498396.153346:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885575936:12345-0@lo:400:kworker.0 Request processed in 12072us (12442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498396.153362:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789498396.153767:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885575936:0@lo:400:kworker.0 00010000:00010000:0.0:1789498396.587733:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498396.651431:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498396.651463:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885576448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498396.651545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498396.651635:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885576448 00000100:00100000:3.0:1789498396.651646:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885576448 00000100:00100000:3.0:1789498396.651711:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498396.651740:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885576448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498396.651792:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498396.651860:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885576448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498396.651868:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789498396.651915:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea874bed80 x1876424885576448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498396.651945:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885576448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498396.652656:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498396.652671:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885576576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498396.652718:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498396.652801:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885576576 00000100:00100000:0.0:1789498396.652807:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885576576 00000100:00100000:0.0:1789498396.652855:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789498396.652865:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885576576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498396.652893:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498396.652953:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885576576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498396.652960:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789498396.653082:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8e680 x1876424885576576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498396.653127:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885576576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789498397.611991:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498398.099004:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498398.099059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498398.099408:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864571648 00000100:00100000:1.0:1789498398.099420:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864571648 00000100:00100000:1.0:1789498398.099467:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00100000:1.0:1789498398.099478:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2358:x1876424864571648:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498398.099567:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2358:x1876424864571648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 89us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498398.099575:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00100000:2.0:1789498398.099860:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864571776 00000100:00100000:2.0:1789498398.099865:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864571776 00000100:00100000:2.0:1789498398.099929:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1789498398.099937:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864571776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498398.099978:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864571776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 43us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498398.099984:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00080000:1.0:1789498398.107201:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789498398.635420:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498399.659772:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498400.683409:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498401.261898:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885576832:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.261975:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498401.262034:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885577344:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262061:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498401.262118:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789498401.262124:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885576704:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262167:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498401.262189:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885577216:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262210:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498401.262234:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885576960:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498401.262272:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498401.262277:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885577088:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262297:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498401.262332:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885576832 00000100:00100000:2.0:1789498401.262341:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885576832 00000100:00100000:2.0:1789498401.262385:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885577216 00000100:00100000:2.0:1789498401.262388:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885577216 00000100:00100000:2.0:1789498401.262411:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885576960 00000100:00100000:2.0:1789498401.262414:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885576960 00000100:00100000:2.0:1789498401.262430:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789498401.262438:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885576832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262492:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885576832:12345-0@lo:400:kworker.0 Request processed in 54us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498401.262498:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789498401.262514:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789498401.262519:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885577216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262545:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885577216:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498401.262550:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789498401.262560:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498401.262565:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885576960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262606:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885576960:12345-0@lo:400:kworker.0 Request processed in 40us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498401.262611:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498401.262628:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885577344 00000100:00100000:2.0:1789498401.262631:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885577344 00000100:00100000:2.0:1789498401.262661:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885577088 00000100:00100000:2.0:1789498401.262663:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885577088 00000100:00100000:2.0:1789498401.262677:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498401.262682:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885577344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262713:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885577344:12345-0@lo:400:kworker.0 Request processed in 31us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498401.262719:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498401.262732:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789498401.262739:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885577088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262765:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885577088:12345-0@lo:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498401.262770:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789498401.262786:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885576704 00000100:00100000:2.0:1789498401.262789:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885576704 00000100:00100000:2.0:1789498401.262814:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789498401.262819:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885576704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262860:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885576704:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498401.262866:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1789498401.262905:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498401.262909:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498401.262912:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789498401.262953:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabae8d180 x1876424885577088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498401.262967:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885577088:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.262977:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885576960:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.263003:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885576704:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.263012:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885577216:0@lo:400:kworker.0 00000100:00100000:2.0:1789498401.263019:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885576832:0@lo:400:kworker.0 00010000:00080000:2.0:1789498401.263028:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabae8f800 x1876424885577344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498401.263036:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885577344:0@lo:400:kworker.0 00010000:00010000:1.0:1789498401.708824:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498401.772336:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498401.772361:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885577472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498401.772430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498401.772505:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885577472 00000100:00100000:1.0:1789498401.772512:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885577472 00000100:00100000:1.0:1789498401.772557:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498401.772567:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885577472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498401.772613:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498401.772675:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885577472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498401.772682:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789498401.772723:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cf8a80 x1876424885577472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498401.772741:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885577472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498401.779264:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885577600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498401.779419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498401.779517:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885577600 00000100:00100000:3.0:1789498401.779527:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885577600 00000100:00100000:3.0:1789498401.779584:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789498401.779594:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885577600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498401.779649:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498401.785488:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885577600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5883us (6057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498401.785503:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789498401.785894:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cf8a80 x1876424885577600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498401.785943:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885577600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789498402.738383:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498403.213667:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498403.213713:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498403.213921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864571904 00000100:00100000:0.0:1789498403.213932:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864571904 00000100:00100000:0.0:1789498403.213991:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:0.0:1789498403.214002:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2358:x1876424864571904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498403.214079:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2358:x1876424864571904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498403.214086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:2.0:1789498403.214849:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864572032 00000100:00100000:2.0:1789498403.214856:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864572032 00000100:00080000:1.0:1789498403.214972:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498403.215011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:2.0:1789498403.215021:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864572032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498403.215085:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864572032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 66us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498403.215117:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 57 00010000:00010000:1.0:1789498403.756595:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498404.785546:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498405.803534:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498406.380545:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885577984:0@lo:400:kworker.0 00000100:00100000:0.0:1789498406.380658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498406.380779:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885578112:0@lo:400:kworker.0 00000100:00100000:0.0:1789498406.380812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498406.380911:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885577856:0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.380946:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498406.380975:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885578368:0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.380998:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498406.381024:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789498406.381052:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885577728:0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381117:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498406.381142:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885578240:0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381167:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498406.381203:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885578112 00000100:00100000:3.0:1789498406.381213:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885578112 00000100:00100000:3.0:1789498406.381302:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885578368 00000100:00100000:3.0:1789498406.381306:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885578368 00000100:00100000:3.0:1789498406.381329:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789498406.381340:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885578112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381411:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885578112:12345-0@lo:400:kworker.0 Request processed in 72us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498406.381419:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789498406.381439:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498406.381445:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885578368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381479:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885578368:12345-0@lo:400:kworker.0 Request processed in 35us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498406.381485:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498406.381505:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885577728 00000100:00100000:3.0:1789498406.381509:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885577728 00000100:00100000:3.0:1789498406.381535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789498406.381541:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885577728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381571:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885577728:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498406.381577:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789498406.381606:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885577984 00000100:00100000:3.0:1789498406.381610:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885577984 00000100:00100000:3.0:1789498406.381645:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885577856 00000100:00100000:3.0:1789498406.381649:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885577856 00000100:00100000:3.0:1789498406.381661:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885578240 00000100:00100000:3.0:1789498406.381663:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885578240 00000100:00100000:3.0:1789498406.381678:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789498406.381684:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885577984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381723:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885577984:12345-0@lo:400:kworker.0 Request processed in 38us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498406.381729:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789498406.381740:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789498406.381746:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885577856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381786:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885577856:12345-0@lo:400:kworker.0 Request processed in 40us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498406.381792:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789498406.381803:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789498406.381809:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885578240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381838:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885578240:12345-0@lo:400:kworker.0 Request processed in 30us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498406.381844:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1789498406.381860:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498406.381866:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498406.381868:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789498406.381905:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8dc00 x1876424885578112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498406.381923:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885578112:0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.381967:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885577984:0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.382001:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885577728:0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.382010:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885578240:0@lo:400:kworker.0 00000100:00100000:3.0:1789498406.382019:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885577856:0@lo:400:kworker.0 00010000:00080000:3.0:1789498406.382029:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8ea00 x1876424885578368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498406.382037:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885578368:0@lo:400:kworker.0 00010000:00010000:1.0:1789498406.827401:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498406.898332:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885578496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498406.898440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498406.898856:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885578496 00000100:00100000:1.0:1789498406.898867:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885578496 00000100:00100000:1.0:1789498406.898935:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789498406.898948:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885578496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498406.899008:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498406.899066:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885578496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498406.899074:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789498406.899152:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cfb480 x1876424885578496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498406.899175:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885578496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498406.910464:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885578624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498406.910589:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498406.910684:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885578624 00000100:00100000:2.0:1789498406.910696:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885578624 00000100:00100000:2.0:1789498406.910797:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498406.910808:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885578624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498406.910872:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498406.910930:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885578624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498406.910937:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789498406.910982:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabae8f800 x1876424885578624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498406.911007:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885578624:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789498407.853633:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498408.335466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498408.335532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498408.336010:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864572160 00000100:00100000:2.0:1789498408.336026:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864572160 00000100:00100000:2.0:1789498408.336115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 206 00000100:00100000:2.0:1789498408.336128:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2358:x1876424864572160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498408.336229:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2358:x1876424864572160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 103us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498408.336237:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 206 00000100:00100000:1.0:1789498408.345958:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864572288 00000100:00100000:1.0:1789498408.345986:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864572288 00000100:00100000:1.0:1789498408.346115:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:1.0:1789498408.346151:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864572288:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498408.346284:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864572288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 137us (10751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498408.346293:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00080000:2.0:1789498408.346592:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498408.877420:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498409.902500:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498410.924775:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498411.500806:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885578880:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.500906:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498411.500971:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885579392:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501002:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498411.501038:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789498411.501045:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885578752:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501078:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498411.501132:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885579264:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501169:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498411.501201:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885579008:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498411.501384:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498411.501391:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885579136:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498411.501470:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885578880 00000100:00100000:3.0:1789498411.501480:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885578880 00000100:00100000:3.0:1789498411.501538:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885579264 00000100:00100000:3.0:1789498411.501542:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885579264 00000100:00100000:3.0:1789498411.501570:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885579008 00000100:00100000:3.0:1789498411.501573:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885579008 00000100:00100000:3.0:1789498411.501592:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789498411.501602:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885578880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501677:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885578880:12345-0@lo:400:kworker.0 Request processed in 75us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498411.501686:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789498411.501705:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498411.501712:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885579264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501743:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885579264:12345-0@lo:400:kworker.0 Request processed in 32us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498411.501749:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498411.501760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789498411.501766:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885579008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501800:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885579008:12345-0@lo:400:kworker.0 Request processed in 34us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498411.501806:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789498411.501824:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885579392 00000100:00100000:3.0:1789498411.501828:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885579392 00000100:00100000:3.0:1789498411.501856:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885579136 00000100:00100000:3.0:1789498411.501859:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885579136 00000100:00100000:3.0:1789498411.501875:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498411.501881:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885579392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501922:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885579392:12345-0@lo:400:kworker.0 Request processed in 41us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498411.501929:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498411.501940:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498411.501946:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885579136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.501991:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885579136:12345-0@lo:400:kworker.0 Request processed in 45us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498411.501997:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498411.502018:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885578752 00000100:00100000:3.0:1789498411.502021:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885578752 00000100:00100000:3.0:1789498411.502052:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789498411.502059:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885578752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.502116:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885578752:12345-0@lo:400:kworker.0 Request processed in 58us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498411.502122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1789498411.502514:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498411.502521:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498411.502525:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789498411.502571:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c3b100 x1876424885579136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498411.502590:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885579136:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.502604:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885579008:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.502638:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885578752:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.502649:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885579264:0@lo:400:kworker.0 00000100:00100000:3.0:1789498411.503540:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885578880:0@lo:400:kworker.0 00010000:00080000:3.0:1789498411.503560:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c3ad80 x1876424885579392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498411.503571:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885579392:0@lo:400:kworker.0 00010000:00010000:1.0:1789498411.951894:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498412.012390:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885579520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498412.012501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498412.012597:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885579520 00000100:00100000:1.0:1789498412.012608:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885579520 00000100:00100000:2.0:1789498412.013570:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885579648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498412.013631:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498412.013802:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885579648 00000100:00100000:1.0:1789498412.013809:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885579648 00000100:00100000:1.0:1789498412.013843:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789498412.013855:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885579520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498412.013912:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498412.014806:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885579520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 949us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498412.014818:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789498412.014854:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789498412.014865:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885579648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498412.014905:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498412.014947:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885579648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498412.014953:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789498412.016941:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabae8f800 x1876424885579648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498412.016976:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885579648:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789498412.017058:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cfb480 x1876424885579520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498412.017074:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885579520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498412.971485:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498413.458961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498413.459033:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498413.459297:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864572416 00000100:00100000:0.0:1789498413.459314:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864572416 00000100:00100000:0.0:1789498413.459387:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 208 00000100:00100000:0.0:1789498413.459400:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864572416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498413.459511:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2356:x1876424864572416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 114us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498413.459520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 208 00000100:00100000:2.0:1789498413.460066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864572544 00000100:00100000:2.0:1789498413.460074:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864572544 00000100:00100000:2.0:1789498413.460201:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:2.0:1789498413.460211:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864572544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498413.460278:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864572544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498413.460285:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00080000:3.0:1789498413.460931:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789498413.995388:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789498414.563729:0:10132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:53:32 (1789498412) === 00010000:00010000:3.0:1789498415.019544:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498415.121313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.121484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864572672 00000100:00100000:2.0:1789498415.121498:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864572672 00000100:00100000:2.0:1789498415.121572:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 209 00000100:00100000:2.0:1789498415.121583:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:8127:x1876424864572672:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498415.121619:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498415.121645:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad24200/0x3a6cb1946bc18259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99f4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498415.121688:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad24200/0x3a6cb1946bc18259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f4a expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498415.121702:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad24200/0x3a6cb1946bc18259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f4a expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498415.121714:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24200, rc 0) 00000100:00100000:2.0:1789498415.121790:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8127:x1876424864572672:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 209us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.121799:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 209 00000100:00100000:1.0:1789498415.131685:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498415.131961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864572800 00000100:00100000:3.0:1789498415.131972:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864572800 00000100:00100000:3.0:1789498415.132027:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 210 00000100:00100000:3.0:1789498415.132037:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8127:x1876424864572800:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789498415.132409:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8127:x1876424864572800:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 372us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498415.132418:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 210 00000100:00100000:1.0:1789498415.148474:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498415.148549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864572928 00000100:00100000:0.0:1789498415.148559:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864572928 00000100:00100000:0.0:1789498415.148627:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 211 00000100:00100000:0.0:1789498415.148638:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8127:x1876424864572928:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789498415.148878:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8127:x1876424864572928:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 241us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498415.148886:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 211 00000100:00100000:2.0:1789498415.160156:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498415.160299:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864573056 00000100:00100000:3.0:1789498415.160309:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864573056 00000100:00100000:3.0:1789498415.160357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 212 00000100:00100000:3.0:1789498415.160367:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8131:x1876424864573056:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789498415.160701:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8131:x1876424864573056:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 335us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498415.160711:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 212 00000100:00100000:1.0:1789498415.199548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.199725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864573184 00000100:00100000:2.0:1789498415.199735:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864573184 00000100:00100000:2.0:1789498415.199834:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 213 00000100:00100000:2.0:1789498415.199845:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8131:x1876424864573184:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498415.200188:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8131:x1876424864573184:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 344us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.200196:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 213 00000100:00100000:1.0:1789498415.208966:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498415.209265:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864573312 00000100:00100000:0.0:1789498415.209276:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864573312 00000100:00100000:0.0:1789498415.209377:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:0.0:1789498415.209388:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:8127:x1876424864573312:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789498415.209409:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498415.209427:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc18260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498415.209457:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc18260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f74 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498415.209469:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc18260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f74 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498415.209488:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640f800, rc 0) 00000100:00100000:0.0:1789498415.209588:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:8127:x1876424864573312:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 201us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498415.209596:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:0.0:1789498415.219213:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.219379:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864573440 00000100:00100000:2.0:1789498415.219390:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864573440 00000100:00100000:2.0:1789498415.219449:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00100000:2.0:1789498415.219460:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:8127:x1876424864573440:12345-192.168.201.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789498415.219605:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789498415.219632:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789498415.219636:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789498415.219639:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789498415.219642:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789498415.222209:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:8127:x1876424864573440:12345-192.168.201.20@tcp:256:mount.lustre.0 Request processed in 2739us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.222223:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00100000:1.0:1789498415.230194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498415.230373:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864573568 00000100:00100000:0.0:1789498415.230383:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864573568 00000100:00100000:0.0:1789498415.230445:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 216 00000100:00100000:0.0:1789498415.230456:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:8127:x1876424864573568:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789498415.230489:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498415.230527:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99f7b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498415.230562:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498415.230573:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498415.230593:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640fc00, rc 0) 00000100:00100000:0.0:1789498415.230662:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8127:x1876424864573568:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 207us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498415.230669:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 216 00000100:00100000:0.0:1789498415.233198:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.233340:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864573696 00000100:00100000:2.0:1789498415.233350:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864573696 00000100:00100000:2.0:1789498415.233410:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 217 00000100:00100000:2.0:1789498415.233420:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8127:x1876424864573696:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789498415.233884:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8127:x1876424864573696:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 464us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.233892:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 217 00000100:00100000:1.0:1789498415.236205:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498415.236287:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864573824 00000100:00100000:3.0:1789498415.236310:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864573824 00000100:00100000:3.0:1789498415.236366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 218 00000100:00100000:3.0:1789498415.236376:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8127:x1876424864573824:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789498415.236628:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8127:x1876424864573824:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 252us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498415.236638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 218 00000100:00100000:1.0:1789498415.240986:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498415.241083:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864573952 00000100:00100000:0.0:1789498415.241120:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864573952 00000100:00100000:0.0:1789498415.241182:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00100000:0.0:1789498415.241191:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8135:x1876424864573952:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498415.241453:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8135:x1876424864573952:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 262us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498415.241462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00100000:0.0:1789498415.245113:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.245200:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864574080 00000100:00100000:2.0:1789498415.245209:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864574080 00000100:00100000:2.0:1789498415.245262:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00100000:2.0:1789498415.245271:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8135:x1876424864574080:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498415.245551:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:8135:x1876424864574080:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 281us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.245559:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00100000:1.0:1789498415.258007:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498415.258161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498415.264711:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864574592 00000100:00100000:3.0:1789498415.264728:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864574592 00000100:00100000:2.0:1789498415.265686:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864574208 00000100:00100000:2.0:1789498415.265695:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864574208 00000100:00100000:2.0:1789498415.265729:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:2.0:1789498415.265741:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864574592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498415.265821:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864574592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (7825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.265828:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:2.0:1789498415.265845:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498415.265849:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1876424864574208:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789498415.265872:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1aabb82d-9fed-48aa-9509-748e4c2edaf4@192.168.201.20@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:2.0:1789498415.265908:0:5846:0:(genops.c:1384:class_connect()) connect: client 1aabb82d-9fed-48aa-9509-748e4c2edaf4, cookie 0x3a6cb1946bc1826e 00000004:00100000:2.0:1789498415.265940:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789498415.266397:0:5846:0:(import.c:65:import_set_state_nolock()) ffff98e98454a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498415.266430:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:2354:x1876424864574208:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 578us (8268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.266438:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00080000:3.0:1789498415.267687:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498415.270695:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.270847:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864574336 00000100:00100000:2.0:1789498415.270858:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864574336 00000100:00100000:2.0:1789498415.270949:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498415.270959:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:0:x1876424864574336:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789498415.271004:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1789498415.271175:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498415.271286:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:0:x1876424864574336:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 327us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.271294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498415.275157:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498415.275350:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864574464 00000100:00100000:1.0:1789498415.275361:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864574464 00000100:00100000:1.0:1789498415.275411:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1789498415.275420:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:8127:x1876424864574464:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789498415.275450:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789498415.275648:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:8127:x1876424864574464:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 228us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498415.275656:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1789498415.277396:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.277543:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864574720 00000100:00100000:2.0:1789498415.277552:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864574720 00000100:00100000:2.0:1789498415.277697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1789498415.277708:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:8127:x1876424864574720:12345-192.168.201.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789498415.277824:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:8127:x1876424864574720:12345-192.168.201.20@tcp:40:mount.lustre.0 Request processed in 118us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498415.277831:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1789498415.294404:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.294591:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498415.294639:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498415.294729:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864574848 00000100:00100000:0.0:1789498415.294742:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864574848 00000100:00100000:0.0:1789498415.294793:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864574976 00000100:00100000:0.0:1789498415.294797:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864574976 00000100:00100000:0.0:1789498415.294816:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:0.0:1789498415.294826:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1876424864574848:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789498415.294887:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1aabb82d-9fed-48aa-9509-748e4c2edaf4@192.168.201.20@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:0.0:1789498415.294921:0:6704:0:(genops.c:1384:class_connect()) connect: client 1aabb82d-9fed-48aa-9509-748e4c2edaf4, cookie 0x3a6cb1946bc18275 00002000:00100000:0.0:1789498415.294933:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1aabb82d-9fed-48aa-9509-748e4c2edaf4/ffff98e987722000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789498415.294960:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789498415.295365:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789498415.295398:0:6704:0:(import.c:65:import_set_state_nolock()) ffff98e987720800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498415.295468:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:2354:x1876424864574848:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 643us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498415.295630:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:0.0:1789498415.295657:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:0.0:1789498415.295663:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1876424864574976:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789498415.295681:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1aabb82d-9fed-48aa-9509-748e4c2edaf4@192.168.201.20@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:0.0:1789498415.295698:0:6704:0:(genops.c:1384:class_connect()) connect: client 1aabb82d-9fed-48aa-9509-748e4c2edaf4, cookie 0x3a6cb1946bc1827c 00002000:00100000:0.0:1789498415.295704:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1aabb82d-9fed-48aa-9509-748e4c2edaf4/ffff98e987721000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789498415.295721:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789498415.295843:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789498415.295858:0:6704:0:(import.c:65:import_set_state_nolock()) ffff98e987721800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498415.295884:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:2354:x1876424864574976:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 220us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498415.295892:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:1.0:1789498415.296771:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864575104 00000100:00100000:1.0:1789498415.296780:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864575104 00000100:00100000:1.0:1789498415.296906:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:1.0:1789498415.296915:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:8127:x1876424864575104:12345-192.168.201.20@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789498415.296993:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789498415.297065:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:8127:x1876424864575104:12345-192.168.201.20@tcp:33:mount.lustre.0 Request processed in 151us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498415.297073:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00010000:00010000:2.0:1789498416.047226:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498416.624467:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885580032:0@lo:400:kworker.0 00000100:00100000:3.0:1789498416.624688:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885579904:0@lo:400:kworker.0 00000100:00100000:0.0:1789498416.624833:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885579776:0@lo:400:kworker.0 00000100:00100000:0.0:1789498416.624879:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498416.624942:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba03a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885580288:0@lo:400:kworker.0 00000100:00100000:3.0:1789498416.625015:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885579776 00000100:00100000:3.0:1789498416.625026:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885579776 00000100:00100000:3.0:1789498416.625131:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789498416.625361:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885579776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498416.625439:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885579776:12345-0@lo:400:kworker.0 Request processed in 298us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498416.625448:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789498416.625909:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498416.626019:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498416.626042:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885580160:0@lo:400:kworker.0 00000100:00100000:1.0:1789498416.626109:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498416.626166:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498416.627343:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba03bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885580416:0@lo:400:kworker.0 00000100:00100000:1.0:1789498416.627408:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498416.627694:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885580160 00000100:00100000:2.0:1789498416.627720:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885580160 00000100:00100000:2.0:1789498416.627799:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885580416 00000100:00100000:2.0:1789498416.627802:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885580416 00000100:00100000:2.0:1789498416.627821:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789498416.627833:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885580160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498416.627908:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885580160:12345-0@lo:400:kworker.0 Request processed in 77us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498416.627916:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789498416.627947:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498416.627952:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885580416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498416.627986:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885580416:12345-0@lo:400:kworker.0 Request processed in 34us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498416.627992:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498416.628014:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789498416.628055:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498416.628068:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498416.628470:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885580032 00000100:00100000:0.0:1789498416.628476:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885580032 00000100:00100000:0.0:1789498416.628578:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885579904 00000100:00100000:0.0:1789498416.628583:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885579904 00000100:00100000:0.0:1789498416.628606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789498416.628613:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885580032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498416.628662:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885580032:12345-0@lo:400:kworker.0 Request processed in 50us (4100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498416.628668:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789498416.628683:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789498416.628690:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885579904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498416.628733:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885579904:12345-0@lo:400:kworker.0 Request processed in 45us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498416.628739:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789498416.630868:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885579776:0@lo:400:kworker.0 00000100:00100000:2.0:1789498416.630919:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885580288 00000100:00100000:2.0:1789498416.630927:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885580288 00000100:00080000:1.0:1789498416.631284:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498416.631410:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789498416.631420:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885580288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498416.631513:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885580288:12345-0@lo:400:kworker.0 Request processed in 94us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498416.631520:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789498416.640860:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885579904:0@lo:400:kworker.0 00010000:00080000:2.0:1789498416.640889:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba03bb80 x1876424885580416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498416.640901:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba03bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885580416:0@lo:400:kworker.0 00010000:00080000:2.0:1789498416.640961:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fab100 x1876424885580160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498416.640973:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885580160:0@lo:400:kworker.0 00000100:00100000:2.0:1789498416.640989:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885580032:0@lo:400:kworker.0 00000100:00100000:2.0:1789498416.641026:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba03a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885580288:0@lo:400:kworker.0 00010000:00010000:3.0:1789498417.069572:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498417.132945:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498417.132982:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885580544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498417.133171:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498417.133427:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885580544 00000100:00100000:3.0:1789498417.133438:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885580544 00000100:00100000:3.0:1789498417.133499:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498417.133508:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885580544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498417.133538:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498417.133617:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885580544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498417.133626:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789498417.133677:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c3b800 x1876424885580544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498417.133713:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885580544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498417.136810:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498417.141342:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885580672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498417.141444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498417.145277:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885580672 00000100:00100000:3.0:1789498417.145303:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885580672 00000100:00100000:3.0:1789498417.145406:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498417.145419:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885580672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498417.145458:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498417.145909:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885580672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 492us (4463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498417.145919:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789498417.154467:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba039c00 x1876424885580672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498417.154505:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885580672:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789498417.778769:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aabb82d-9fed-48aa-9509-748e4c2edaf4 00010000:00010000:2.0:1789498418.091691:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789498418.272817:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aabb82d-9fed-48aa-9509-748e4c2edaf4 00000001:00100000:3.0:1789498418.780335:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aabb82d-9fed-48aa-9509-748e4c2edaf4 00010000:00010000:3.0:1789498419.117162:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498420.140950:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498420.628371:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498420.628417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498420.628447:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498420.628484:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498420.628524:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498420.628553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864575488 00000100:00100000:2.0:1789498420.628563:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864575488 00000100:00100000:2.0:1789498420.628620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864575360 00000100:00100000:2.0:1789498420.628623:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864575360 00000100:00100000:2.0:1789498420.628645:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:2.0:1789498420.628656:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864575488:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498420.628722:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864575488:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498420.628730:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:2.0:1789498420.628745:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:2.0:1789498420.628751:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864575360:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498420.628864:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864575360:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 112us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498420.628872:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:2.0:1789498420.628905:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864575744 00000100:00100000:2.0:1789498420.628909:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864575744 00000100:00100000:2.0:1789498420.628931:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864575616 00000100:00100000:2.0:1789498420.628934:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864575616 00000100:00100000:2.0:1789498420.629164:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1789498420.629171:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864575744:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498420.629310:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864575744:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 139us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498420.629319:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1789498420.629331:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:2.0:1789498420.629337:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864575616:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498420.629361:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864575616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498420.629367:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00080000:1.0:1789498420.629517:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498420.629522:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498420.629524:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498420.629593:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864575232 00000100:00100000:0.0:1789498420.629598:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864575232 00000100:00100000:0.0:1789498420.629637:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 222 00000100:00100000:0.0:1789498420.629654:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864575232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498420.629682:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864575232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498420.629688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 222 00010000:00010000:3.0:1789498421.163874:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498421.742183:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885580800:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742250:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498421.742296:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885581312:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742318:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498421.742339:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789498421.742343:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885580928:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742356:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498421.742366:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885581440:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742381:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498421.742403:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885581056:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742417:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498421.742428:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498421.742431:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885581184:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742442:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498421.742466:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885580800 00000100:00100000:0.0:1789498421.742474:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885580800 00000100:00100000:0.0:1789498421.742528:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789498421.742537:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885580800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742576:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885580800:12345-0@lo:400:kworker.0 Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498421.742581:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789498421.742608:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885581312 00000100:00100000:0.0:1789498421.742612:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885581312 00000100:00100000:0.0:1789498421.742643:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885580928 00000100:00100000:0.0:1789498421.742646:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885580928 00000100:00100000:0.0:1789498421.742656:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885581056 00000100:00100000:0.0:1789498421.742659:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885581056 00000100:00100000:0.0:1789498421.742673:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498421.742677:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742708:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885581312:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498421.742712:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498421.742720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498421.742724:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885580928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742738:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885580928:12345-0@lo:400:kworker.0 Request processed in 14us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498421.742741:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498421.742747:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789498421.742750:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885581056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742767:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885581056:12345-0@lo:400:kworker.0 Request processed in 17us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498421.742771:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789498421.742783:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885581440 00000100:00100000:0.0:1789498421.742785:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885581440 00000100:00100000:0.0:1789498421.742801:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885581184 00000100:00100000:0.0:1789498421.742803:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885581184 00000100:00100000:0.0:1789498421.742810:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789498421.742814:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885581440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742835:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885581440:12345-0@lo:400:kworker.0 Request processed in 20us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498421.742841:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789498421.742852:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789498421.742858:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885581184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742883:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885581184:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498421.742898:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789498421.742926:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498421.742930:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498421.742932:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789498421.742965:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8c380 x1876424885581184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498421.742990:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885581184:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.742999:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885581056:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.743017:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885580928:0@lo:400:kworker.0 00010000:00080000:0.0:1789498421.743023:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8c700 x1876424885581440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498421.743029:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885581440:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.743033:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885580800:0@lo:400:kworker.0 00000100:00100000:0.0:1789498421.743038:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885581312:0@lo:400:kworker.0 00000001:02000400:3.0:1789498422.190190:0:10327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789498422.202075:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498422.251408:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498422.251434:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885581568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498422.251534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498422.251702:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885581568 00000100:00100000:1.0:1789498422.251712:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885581568 00000100:00100000:1.0:1789498422.251771:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498422.251781:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885581568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498422.251823:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498422.251874:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885581568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498422.251881:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789498422.251959:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba038000 x1876424885581568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498422.251979:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885581568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498422.252328:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498422.252341:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885581696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498422.252374:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498422.252458:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885581696 00000100:00100000:3.0:1789498422.252483:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885581696 00000100:00100000:3.0:1789498422.252528:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498422.252536:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885581696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498422.252560:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498422.252594:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885581696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498422.252613:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789498422.252910:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c39f80 x1876424885581696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498422.252924:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885581696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789498423.211268:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498424.246239:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498425.259675:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498425.758579:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498425.758835:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864575872 00000100:00100000:0.0:1789498425.758848:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864575872 00000100:00100000:0.0:1789498425.758914:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00100000:0.0:1789498425.758925:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864575872:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498425.759010:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864575872:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 87us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498425.759018:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00100000:0.0:1789498425.759828:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498425.759860:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498425.759922:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498425.759947:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864576000 00000100:00100000:1.0:1789498425.759956:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864576000 00000100:00100000:0.0:1789498425.759958:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498425.759979:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864576256 00000100:00100000:0.0:1789498425.759982:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864576256 00000100:00100000:0.0:1789498425.760015:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864576384 00000100:00100000:0.0:1789498425.760018:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864576384 00000100:00100000:0.0:1789498425.760035:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:0.0:1789498425.760043:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864576256:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498425.760072:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789498425.760082:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789498425.760120:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864576256:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498425.760127:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:0.0:1789498425.760140:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:0.0:1789498425.760147:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864576384:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498425.760183:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864576384:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498425.760600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864576128 00000100:00100000:2.0:1789498425.760605:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864576128 00000100:00100000:2.0:1789498425.760646:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:2.0:1789498425.760664:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864576128:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498425.760716:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864576128:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 53us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498425.760723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00080000:2.0:1789498425.760851:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498425.760857:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498425.760859:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498425.762458:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:1.0:1789498425.762476:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864576000:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498425.762549:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864576000:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498425.762556:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:0.0:1789498425.772134:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00010000:00010000:1.0:1789498426.284364:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498426.865700:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885582080:0@lo:400:kworker.0 00000100:00100000:1.0:1789498426.865770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498426.865824:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498426.865829:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885582208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498426.865850:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498426.865900:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885582080 00000100:00100000:1.0:1789498426.865907:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885582080 00000100:00100000:1.0:1789498426.865959:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789498426.865969:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885582080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498426.866017:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885582080:12345-0@lo:400:kworker.0 Request processed in 50us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498426.866024:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789498426.866046:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885582208 00000100:00100000:1.0:1789498426.866049:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885582208 00000100:00100000:1.0:1789498426.866080:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789498426.866086:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885582208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498426.866142:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885582208:12345-0@lo:400:kworker.0 Request processed in 56us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498426.866147:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789498426.866160:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498426.866176:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789498426.866201:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba039180 x1876424885582208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498426.866215:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885582208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498426.866224:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885582080:0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866450:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885581824:0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866485:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498426.866515:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885582336:0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866535:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498426.866553:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789498426.866557:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba03aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885581952:0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866574:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498426.866585:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885582464:0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866600:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498426.866635:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885582336 00000100:00100000:0.0:1789498426.866639:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885582336 00000100:00100000:0.0:1789498426.866662:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885581952 00000100:00100000:0.0:1789498426.866664:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885581952 00000100:00100000:0.0:1789498426.866677:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789498426.866683:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885582336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866713:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885582336:12345-0@lo:400:kworker.0 Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498426.866718:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789498426.866729:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789498426.866734:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885581952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866754:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885581952:12345-0@lo:400:kworker.0 Request processed in 20us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498426.866759:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789498426.866772:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885582464 00000100:00100000:0.0:1789498426.866774:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885582464 00000100:00100000:0.0:1789498426.866793:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789498426.866798:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885582464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866822:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885582464:12345-0@lo:400:kworker.0 Request processed in 23us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498426.866827:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789498426.866841:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498426.866844:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498426.866858:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba03aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885581952:0@lo:400:kworker.0 00010000:00080000:0.0:1789498426.866868:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba03b800 x1876424885582464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498426.866889:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885582464:0@lo:400:kworker.0 00000100:00100000:0.0:1789498426.866904:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885582336:0@lo:400:kworker.0 00000100:00100000:1.0:1789498426.867133:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885581824 00000100:00100000:1.0:1789498426.867137:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885581824 00000100:00100000:1.0:1789498426.867289:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789498426.867298:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885581824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498426.867334:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885581824:12345-0@lo:400:kworker.0 Request processed in 38us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498426.874383:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885581824:0@lo:400:kworker.0 00000100:00100000:1.0:1789498426.875533:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00010000:3.0:1789498427.307260:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498427.371427:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498427.371461:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885582592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498427.371535:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498427.371740:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885582592 00000100:00100000:0.0:1789498427.371748:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885582592 00000100:00100000:0.0:1789498427.371799:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789498427.371807:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885582592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498427.371848:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498427.371900:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885582592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498427.371906:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789498427.372135:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba038e00 x1876424885582592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498427.372154:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885582592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498427.372371:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885582720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498427.372423:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498427.372700:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885582720 00000100:00100000:3.0:1789498427.372705:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885582720 00000100:00100000:3.0:1789498427.372743:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789498427.372750:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885582720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498427.372774:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498427.372817:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885582720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498427.372822:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789498427.372989:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c38a80 x1876424885582720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498427.373003:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885582720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789498428.333214:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498429.355380:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498430.382927:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498430.883536:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498430.883577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498430.883608:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498430.883633:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498430.883654:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498430.883680:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864577024 00000100:00100000:0.0:1789498430.883688:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864577024 00000100:00100000:0.0:1789498430.883741:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864576896 00000100:00100000:0.0:1789498430.883745:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864576896 00000100:00100000:0.0:1789498430.883770:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:0.0:1789498430.883779:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864577024:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498430.883860:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864577024:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498430.883867:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:0.0:1789498430.883898:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:0.0:1789498430.883905:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864576896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498430.883939:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864576896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498430.883945:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:0.0:1789498430.883964:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864576768 00000100:00100000:0.0:1789498430.883968:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864576768 00000100:00100000:0.0:1789498430.883992:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864576640 00000100:00100000:0.0:1789498430.883995:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864576640 00000100:00100000:0.0:1789498430.884016:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:0.0:1789498430.884022:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864576768:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498430.884049:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864576768:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498430.884056:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:0.0:1789498430.884068:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:0.0:1789498430.884074:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864576640:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498430.884129:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864576640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 54us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498430.884135:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00080000:0.0:1789498430.884154:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498430.884159:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498430.884161:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498430.885483:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864576512 00000100:00100000:3.0:1789498430.885494:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864576512 00000100:00100000:3.0:1789498430.885555:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 226 00000100:00100000:3.0:1789498430.885564:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864576512:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498430.885624:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864576512:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 60us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498430.885631:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 226 00010000:00010000:3.0:1789498431.404036:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498431.984827:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885582848:0@lo:400:kworker.0 00000100:00100000:0.0:1789498431.984898:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498431.984986:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885582848 00000100:00100000:1.0:1789498431.984995:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885582848 00000100:00100000:1.0:1789498431.985059:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789498431.985067:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885582848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498431.987307:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885582976:0@lo:400:kworker.0 00000100:00100000:2.0:1789498431.987401:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498431.987613:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885582848:12345-0@lo:400:kworker.0 Request processed in 2545us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498431.987624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789498431.988455:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885583104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498431.988495:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498431.988532:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498431.988539:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885583232:0@lo:400:kworker.0 00000100:00100000:1.0:1789498431.988564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498431.988608:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885582976 00000100:00100000:1.0:1789498431.988616:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885582976 00000100:00100000:1.0:1789498431.988658:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885583104 00000100:00100000:1.0:1789498431.988661:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885583104 00000100:00100000:1.0:1789498431.988688:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789498431.988696:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885582976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498431.988739:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885582976:12345-0@lo:400:kworker.0 Request processed in 44us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498431.988746:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789498431.988757:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789498431.988763:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885583104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498431.988786:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885583104:12345-0@lo:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498431.988791:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789498431.988804:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885583232 00000100:00100000:1.0:1789498431.988807:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885583232 00000100:00100000:1.0:1789498431.988828:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789498431.988833:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885583232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498431.988858:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885583232:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498431.988863:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789498431.988878:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498431.988882:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789498431.988905:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c3aa00 x1876424885583232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498431.988918:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885583232:0@lo:400:kworker.0 00000100:00100000:1.0:1789498431.988927:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885583104:0@lo:400:kworker.0 00000100:00100000:2.0:1789498431.989733:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885583488:0@lo:400:kworker.0 00000100:00100000:2.0:1789498431.989774:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498431.989829:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885582976:0@lo:400:kworker.0 00000100:00100000:2.0:1789498431.989844:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498431.989850:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885583360:0@lo:400:kworker.0 00000100:00100000:2.0:1789498431.989874:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498431.990468:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885583488 00000100:00100000:1.0:1789498431.990475:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885583488 00000100:00100000:1.0:1789498431.990535:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789498431.990544:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885583488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498431.990595:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885583488:12345-0@lo:400:kworker.0 Request processed in 52us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498431.990601:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789498431.990620:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885583360 00000100:00100000:1.0:1789498431.990624:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885583360 00000100:00100000:1.0:1789498431.990648:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789498431.990653:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885583360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498431.990680:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885583360:12345-0@lo:400:kworker.0 Request processed in 27us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498431.990685:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789498431.990717:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885583360:0@lo:400:kworker.0 00010000:00080000:1.0:1789498431.990730:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c39180 x1876424885583488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498431.990740:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885583488:0@lo:400:kworker.0 00000100:00080000:2.0:1789498431.990874:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498431.990879:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498431.991834:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885582848:0@lo:400:kworker.0 00010000:00010000:1.0:1789498432.427331:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498432.493687:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885583744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498432.493771:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498432.493884:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498432.493891:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885583616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498432.493914:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498432.494078:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885583744 00000100:00100000:3.0:1789498432.494112:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885583744 00000100:00100000:3.0:1789498432.494150:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885583616 00000100:00100000:3.0:1789498432.494153:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885583616 00000100:00100000:3.0:1789498432.494165:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789498432.494173:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885583744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498432.494210:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498432.494307:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885583744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498432.494315:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789498432.494333:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789498432.494339:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885583616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498432.494360:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1789498432.494399:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba038e00 x1876424885583744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498432.494419:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885583744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498432.507966:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885583616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13615us (14039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498432.507980:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789498432.509699:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c39500 x1876424885583616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498432.509725:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885583616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789498433.451200:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498434.479908:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498435.501609:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498435.988877:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498435.989209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498435.989249:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498435.989271:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498435.989335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498435.989366:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864577280 00000100:00100000:0.0:1789498435.989376:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864577280 00000100:00100000:0.0:1789498435.989433:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864577408 00000100:00100000:0.0:1789498435.989437:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864577408 00000100:00100000:0.0:1789498435.989458:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1789498435.989468:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864577280:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498435.989570:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864577280:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498435.989578:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1789498435.989597:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:0.0:1789498435.989603:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864577408:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498435.989628:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864577408:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498435.989633:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:0.0:1789498435.989650:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864577152 00000100:00100000:0.0:1789498435.989654:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864577152 00000100:00100000:2.0:1789498435.990253:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:2.0:1789498435.990264:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864577152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498435.990297:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864577152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498435.990303:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:0.0:1789498435.993262:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864577536 00000100:00100000:0.0:1789498435.993280:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864577536 00000100:00100000:0.0:1789498435.993346:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864577664 00000100:00100000:0.0:1789498435.993350:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864577664 00000100:00100000:0.0:1789498435.993395:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:0.0:1789498435.993407:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2354:x1876424864577536:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:0.0:1789498435.993437:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18275 00000100:00080000:0.0:1789498435.993448:0:6702:0:(import.c:65:import_set_state_nolock()) ffff98e987720800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789498435.993494:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1789498435.996674:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498435.996684:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498435.996688:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498435.996716:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:1.0:1789498435.996733:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2354:x1876424864577664:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:1.0:1789498435.996772:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1827c 00000100:00080000:1.0:1789498435.996785:0:6704:0:(import.c:65:import_set_state_nolock()) ffff98e987721800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789498435.999402:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+2:2354:x1876424864577536:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 5986us (10116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498435.999415:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00010000:00010000:0.0:1789498436.008047:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789498436.010124:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789498436.010555:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+2:2354:x1876424864577664:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 13821us (21211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498436.010568:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00010000:00010000:3.0:1789498436.010804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498436.523605:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498437.102963:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885584128:0@lo:400:kworker.0 00000100:00100000:2.0:1789498437.103043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498437.103138:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498437.103146:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885584256:0@lo:400:kworker.0 00000100:00100000:2.0:1789498437.103173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498437.103223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885584128 00000100:00100000:2.0:1789498437.103232:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885584128 00000100:00100000:2.0:1789498437.103283:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789498437.103293:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885584128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498437.103346:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885584128:12345-0@lo:400:kworker.0 Request processed in 55us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498437.103353:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789498437.103375:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885584256 00000100:00100000:2.0:1789498437.103378:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885584256 00000100:00100000:2.0:1789498437.103406:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789498437.103413:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885584256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498437.103442:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885584256:12345-0@lo:400:kworker.0 Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498437.103448:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789498437.103487:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fa8a80 x1876424885584256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498437.103502:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885584256:0@lo:400:kworker.0 00000100:00100000:2.0:1789498437.103512:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885584128:0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.103607:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9faaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885583872:0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.103640:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498437.103672:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885584384:0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.103702:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498437.103723:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789498437.103728:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885584000:0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.103748:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498437.103762:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885584512:0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.103780:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789498437.103816:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498437.103821:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498437.103830:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885584384 00000100:00100000:1.0:1789498437.103834:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885584384 00000100:00100000:1.0:1789498437.103870:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885584000 00000100:00100000:1.0:1789498437.103874:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885584000 00000100:00100000:1.0:1789498437.103890:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789498437.103896:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885584384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.103930:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885584384:12345-0@lo:400:kworker.0 Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498437.103937:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789498437.103949:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789498437.103955:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885584000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.103981:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885584000:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498437.103986:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1789498437.104003:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498437.104019:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885584000:0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.104028:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885584384:0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.104390:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885584512 00000100:00100000:1.0:1789498437.104395:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885584512 00000100:00100000:1.0:1789498437.104425:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789498437.104431:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885584512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498437.104468:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885584512:12345-0@lo:400:kworker.0 Request processed in 37us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498437.104474:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789498437.104491:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789498437.104510:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaaaea00 x1876424885584512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498437.104519:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885584512:0@lo:400:kworker.0 00000100:00100000:2.0:1789498437.105184:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885583872 00000100:00100000:2.0:1789498437.105192:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885583872 00000100:00100000:2.0:1789498437.105244:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789498437.105253:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885583872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498437.105299:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885583872:12345-0@lo:400:kworker.0 Request processed in 47us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498437.105312:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789498437.105394:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9faaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885583872:0@lo:400:kworker.0 00010000:00010000:3.0:1789498437.547282:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498437.611278:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498437.611303:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885584640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498437.611377:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498437.611461:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885584640 00000100:00100000:1.0:1789498437.611470:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885584640 00000100:00100000:1.0:1789498437.611523:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789498437.611532:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885584640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498437.611572:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498437.611621:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885584640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498437.611628:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789498437.611670:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba03b800 x1876424885584640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498437.611688:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885584640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498437.611995:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498437.612005:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885584768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498437.612049:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498437.612241:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885584768 00000100:00100000:3.0:1789498437.612246:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885584768 00000100:00100000:3.0:1789498437.612286:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789498437.612294:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885584768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498437.612318:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498437.612405:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885584768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498437.612411:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789498437.612454:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c39500 x1876424885584768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498437.612468:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885584768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789498438.571463:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789498438.717616:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aabb82d-9fed-48aa-9509-748e4c2edaf4 00000020:00000080:2.0:1789498438.717626:0:7653:0:(genops.c:885:class_export_put()) final put ffff98e987721000/1aabb82d-9fed-48aa-9509-748e4c2edaf4 00000020:00000080:0.0:1789498438.728449:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98e987721000/1aabb82d-9fed-48aa-9509-748e4c2edaf4 for lustre-OST0001 00000020:00000080:0.0:1789498438.728510:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e987721800 for lustre-OST0001 00000001:00100000:0.0:1789498439.248596:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aabb82d-9fed-48aa-9509-748e4c2edaf4 00000020:00000080:0.0:1789498439.248605:0:6726:0:(genops.c:885:class_export_put()) final put ffff98e987722000/1aabb82d-9fed-48aa-9509-748e4c2edaf4 00000020:00000080:0.0:1789498439.248632:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e987722000/1aabb82d-9fed-48aa-9509-748e4c2edaf4 for lustre-OST0000 00000020:00000080:0.0:1789498439.248671:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e987720800 for lustre-OST0000 00010000:00010000:3.0:1789498439.596222:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498440.619529:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498441.108940:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498441.109075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498441.109155:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498441.109228:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864577920 00000100:00100000:2.0:1789498441.109240:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864577920 00000100:00100000:3.0:1789498441.109380:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864578048 00000100:00100000:3.0:1789498441.109385:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864578048 00000100:00100000:2.0:1789498441.109407:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1789498441.109420:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2357:x1876424864577920:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498441.109501:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2357:x1876424864577920:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498441.109508:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00080000:1.0:1789498441.109669:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498441.111219:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864577792 00000100:00100000:0.0:1789498441.111231:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864577792 00000100:00100000:1.0:1789498441.111425:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00100000:1.0:1789498441.111436:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864577792:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498441.111507:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864577792:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 72us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498441.111530:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00100000:2.0:1789498441.111607:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:2.0:1789498441.111615:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864578048:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498441.111644:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864578048:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498441.111649:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00010000:00010000:3.0:1789498441.643691:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498442.219668:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885584896:0@lo:400:kworker.0 00000100:00100000:1.0:1789498442.219759:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498442.219870:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885584896 00000100:00100000:2.0:1789498442.219879:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885584896 00000100:00100000:2.0:1789498442.219940:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789498442.219949:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885584896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498442.220643:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885585024:0@lo:400:kworker.0 00000100:00100000:0.0:1789498442.220700:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498442.220976:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885584896:12345-0@lo:400:kworker.0 Request processed in 1027us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498442.220985:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789498442.221050:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885585024 00000100:00100000:2.0:1789498442.221055:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885585024 00000100:00100000:2.0:1789498442.221123:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789498442.221131:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885585024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498442.221175:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885585024:12345-0@lo:400:kworker.0 Request processed in 46us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498442.221182:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789498442.221217:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885585024:0@lo:400:kworker.0 00000100:00100000:1.0:1789498442.221293:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885584896:0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221420:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885585152:0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221449:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498442.221483:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498442.221490:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885585280:0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221514:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498442.221543:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885585152 00000100:00100000:3.0:1789498442.221547:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885585152 00000100:00100000:3.0:1789498442.221580:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789498442.221587:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885585152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221634:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885585152:12345-0@lo:400:kworker.0 Request processed in 49us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498442.221650:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789498442.221670:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885585280 00000100:00100000:3.0:1789498442.221673:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885585280 00000100:00100000:3.0:1789498442.221700:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789498442.221706:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885585280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221735:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885585280:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498442.221741:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789498442.221755:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498442.221760:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789498442.221782:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c38e00 x1876424885585280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498442.221793:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885585280:0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221803:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885585152:0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221823:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885585536:0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221845:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498442.221863:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498442.221869:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885585408:0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221889:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498442.221912:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885585536 00000100:00100000:3.0:1789498442.221916:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885585536 00000100:00100000:3.0:1789498442.221943:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789498442.221949:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885585536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.221979:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885585536:12345-0@lo:400:kworker.0 Request processed in 30us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498442.221994:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789498442.222010:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885585408 00000100:00100000:3.0:1789498442.222014:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885585408 00000100:00100000:3.0:1789498442.222037:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789498442.222043:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885585408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498442.222071:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885585408:12345-0@lo:400:kworker.0 Request processed in 28us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498442.222076:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1789498442.223188:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498442.223194:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498442.223227:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885585408:0@lo:400:kworker.0 00010000:00080000:2.0:1789498442.223256:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c39880 x1876424885585536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498442.223267:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885585536:0@lo:400:kworker.0 00010000:00010000:1.0:1789498442.676734:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498442.731674:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498442.731705:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885585664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498442.731802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498442.732182:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885585792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498442.732214:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498442.732256:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885585664 00000100:00100000:3.0:1789498442.732267:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885585664 00000100:00100000:3.0:1789498442.732324:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885585792 00000100:00100000:3.0:1789498442.732327:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885585792 00000100:00100000:3.0:1789498442.732346:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789498442.732356:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885585664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498442.732407:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498442.732460:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885585664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498442.732469:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789498442.732489:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789498442.732496:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885585792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498442.732521:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498442.732556:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885585792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498442.732563:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789498442.732606:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c39f80 x1876424885585792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498442.732626:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885585792:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789498442.732639:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c3bb80 x1876424885585664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498442.732651:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885585664:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789498442.883914:0:11031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789498443.691289:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498444.722699:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498445.740204:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498446.226848:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498446.226892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498446.227035:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864578304 00000100:00100000:3.0:1789498446.227057:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864578304 00000100:00100000:3.0:1789498446.227165:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:3.0:1789498446.227175:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2357:x1876424864578304:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498446.227249:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2357:x1876424864578304:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498446.227269:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:0.0:1789498446.227352:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864578176 00000100:00100000:0.0:1789498446.227357:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864578176 00000100:00100000:0.0:1789498446.227398:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 232 00000100:00100000:0.0:1789498446.227405:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864578176:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498446.227433:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864578176:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498446.227440:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 232 00000100:00100000:3.0:1789498446.228465:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498446.228913:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864578432 00000100:00100000:0.0:1789498446.228922:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864578432 00000100:00100000:0.0:1789498446.228974:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:0.0:1789498446.228983:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864578432:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498446.229053:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864578432:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 58us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498446.229062:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00080000:2.0:1789498446.229137:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789498446.766757:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789498447.287545:0:11179:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0c2f49e0 20000000:00000080:3.0:1789498447.287567:0:11179:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98eabad8fc00 uarg=0000000000000000 20000000:01000000:3.0:1789498447.287666:0:11179:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789498447.287671:0:11179:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789498447.287676:0:11179:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789498447.288904:0:11180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789498447.289242:0:11179:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789498447.296324:0:11179:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789498447.296473:0:11179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296498:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296507:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296584:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296665:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296673:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296680:0:11179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296724:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296739:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 12 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.296755:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885585920:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498447.296956:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.296965:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 18 pid: 5840 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.296974:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885586048:0@lo:104: 00000100:00100000:2.0:1789498447.297015:0:11179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498447.297131:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.297139:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 18 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.297154:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885586176:0@lo:104: 00000100:00100000:2.0:1789498447.297175:0:11179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498447.301471:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498447.301667:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864578560 00000100:00100000:0.0:1789498447.301678:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864578560 00010000:00010000:0.0:1789498447.301726:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 13 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498447.301766:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1789498447.301776:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85661050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864578560:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498447.301793:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498447.301799:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 13 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498447.301812:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 13 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498447.301833:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498447.301886:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85661050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864578560:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 110us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498447.301893:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00010000:00010000:2.0:1789498447.303756:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.303780:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 18 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.303810:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885586304:0@lo:104: 00000100:00100000:2.0:1789498447.303882:0:11179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498447.304079:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885586048 00000100:00100000:1.0:1789498447.304104:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885586048 00000100:00100000:1.0:1789498447.304142:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885586176 00000100:00100000:1.0:1789498447.304145:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885586176 00000100:00100000:1.0:1789498447.304157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498447.304165:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:11179:x1876424885586048:12345-0@lo:104: 00010000:00010000:1.0:1789498447.304179:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304230:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789498447.304235:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:11179:x1876424885586048:12345-0@lo:104: Request processed in 72us (7221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498447.304243:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498447.304270:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789498447.304276:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:11179:x1876424885586176:12345-0@lo:104: 00010000:00010000:1.0:1789498447.304283:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304333:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789498447.304338:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:11179:x1876424885586176:12345-0@lo:104: Request processed in 63us (7162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498447.304344:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789498447.304360:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789498447.304366:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304373:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498447.304377:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304386:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498447.304393:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498447.304399:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789498447.304424:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304431:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498447.304450:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304457:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20db400/0x3a6cb1946bc1824b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18252 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304482:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498447.304485:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304491:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498447.304494:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304501:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498447.304506:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498447.304522:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789498447.304533:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304539:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498447.304545:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304552:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20dbc00/0x3a6cb1946bc1823d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18244 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304559:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498447.304561:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498447.304562:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498447.304574:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885586432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498447.304618:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498447.304644:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498447.304649:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885586560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498447.304665:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498447.304694:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885586432 00000100:00100000:1.0:1789498447.304698:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885586432 00010000:00010000:1.0:1789498447.304715:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 19 pid: 5840 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498447.304733:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885586560 00000100:00100000:1.0:1789498447.304736:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885586560 00010000:00010000:1.0:1789498447.304745:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 20 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498447.304756:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789498447.304762:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3307:x1876424885586432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498447.304772:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498447.304777:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 20 pid: 5840 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.304787:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 20 pid: 5840 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498447.304891:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498447.305221:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498447.305293:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3307:x1876424885586432:12345-0@lo:103:ldlm_bl.0 Request processed in 531us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498447.305301:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789498447.305316:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498447.305322:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885586560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498447.305337:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498447.305342:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 19 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.305351:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 19 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.305360:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498447.305378:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885586560:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498447.305384:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498447.305873:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885586304 00000100:00100000:1.0:1789498447.305879:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885586304 00000100:00100000:1.0:1789498447.305902:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498447.305907:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:11179:x1876424885586304:12345-0@lo:104: 00010000:00010000:1.0:1789498447.305918:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.305955:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789498447.305959:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:11179:x1876424885586304:12345-0@lo:104: Request processed in 53us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498447.305965:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789498447.305976:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498447.305981:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.305988:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80031600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498447.305991:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.306010:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498447.306017:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498447.306037:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789498447.306161:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.306168:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498447.306184:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.306192:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80031600/0x3a6cb1946bc1822f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc18236 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.306207:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498447.306209:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498447.306210:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498447.306221:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885586688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498447.306249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498447.306378:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.306391:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 12 pid: 5839 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.306402:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885586816:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498447.306449:0:11179:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa055f6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789498447.306470:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc18267 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f7b expref: 12 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.306482:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885585920:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498447.306492:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc18252 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc1824b expref: 18 pid: 5840 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.306501:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885586048:0@lo:104: 00000100:00100000:0.0:1789498447.306693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885586688 00000100:00100000:0.0:1789498447.306698:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885586688 00010000:00010000:0.0:1789498447.306719:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 18 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498447.306740:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789498447.306746:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:3305:x1876424885586688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498447.306755:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498447.306760:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 18 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498447.306768:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 18 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498447.306781:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498447.306890:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80030000/0x3a6cb1946bc18244 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc1823d expref: 18 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.306906:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885586176:0@lo:104: 00010000:00010000:2.0:1789498447.306919:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac20db800/0x3a6cb1946bc18236 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc1822f expref: 17 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.306928:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885586304:0@lo:104: 00000100:00100000:0.0:1789498447.306986:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3305:x1876424885586688:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498447.306992:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498447.307336:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885586688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498447.309263:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885586432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498447.309292:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885586560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498447.312436:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498447.312510:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864578688 00000100:00100000:1.0:1789498447.312531:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864578688 00010000:00010000:1.0:1789498447.312583:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 12 pid: 5839 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498447.312634:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:1.0:1789498447.312660:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:2356:x1876424864578688:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498447.312677:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498447.312683:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 12 pid: 5839 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312695:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 12 pid: 5839 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312717:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312725:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312741:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312749:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312756:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312764:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312770:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498447.312775:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312785:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312815:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498447.312828:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498447.312896:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:2356:x1876424864578688:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 237us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498447.312903:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00010000:00010000:2.0:1789498447.313165:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac20db000/0x3a6cb1946bc18228 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f43 expref: 11 pid: 5839 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498447.313181:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1876424885586816:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498447.313213:0:11179:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.313222:0:11179:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.313228:0:11179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498447.313233:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad25c00/0x3a6cb1946bc18283 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498447.353679:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885586944:0@lo:400:kworker.0 00000100:00100000:0.0:1789498447.353765:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498447.353879:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885587072:0@lo:400:kworker.0 00000100:00100000:2.0:1789498447.353906:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498447.353950:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498447.353955:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885587200:0@lo:400:kworker.0 00000100:00100000:2.0:1789498447.353978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498447.354004:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885587200 00000100:00100000:2.0:1789498447.354018:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885587200 00000100:00100000:2.0:1789498447.354110:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789498447.354118:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885587200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498447.354169:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885587200:12345-0@lo:400:kworker.0 Request processed in 52us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498447.354176:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789498447.354193:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789498447.354220:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaaadf80 x1876424885587200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498447.354235:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885587200:0@lo:400:kworker.0 00000100:00100000:1.0:1789498447.359952:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885587328:0@lo:400:kworker.0 00000100:00100000:1.0:1789498447.360039:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498447.360152:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885586944 00000100:00100000:1.0:1789498447.360160:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885586944 00000100:00100000:1.0:1789498447.360203:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885587072 00000100:00100000:1.0:1789498447.360206:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885587072 00000100:00100000:1.0:1789498447.360227:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885587328 00000100:00100000:1.0:1789498447.360230:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885587328 00000100:00100000:1.0:1789498447.360244:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789498447.360252:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885586944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498447.364636:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789498447.364662:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885587072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498447.364777:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885587072:12345-0@lo:400:kworker.0 Request processed in 127us (10869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498447.364785:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789498447.364821:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789498447.364828:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885587328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498447.364868:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885587328:12345-0@lo:400:kworker.0 Request processed in 40us (4829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498447.364874:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789498447.366078:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885587072:0@lo:400:kworker.0 00000100:00100000:1.0:1789498447.366662:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885586944:12345-0@lo:400:kworker.0 Request processed in 6406us (12893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498447.366673:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789498447.366724:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885587328:0@lo:400:kworker.0 00000100:00100000:1.0:1789498447.366739:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498447.366749:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885587456:0@lo:400:kworker.0 00000100:00100000:1.0:1789498447.367036:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789498447.367113:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498447.367919:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885587456 00000100:00100000:2.0:1789498447.367930:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885587456 00000100:00100000:2.0:1789498447.367995:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789498447.368005:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885587456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498447.368110:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885587456:12345-0@lo:400:kworker.0 Request processed in 108us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498447.368117:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789498447.368135:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789498447.368160:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaaae680 x1876424885587456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498447.368171:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885587456:0@lo:400:kworker.0 00000100:00100000:0.0:1789498447.370228:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885586944:0@lo:400:kworker.0 00010000:00010000:3.0:1789498447.788192:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498447.851622:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885587584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498447.851707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498447.852024:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498447.852048:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885587712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498447.852075:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498447.852180:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885587584 00000100:00100000:0.0:1789498447.852189:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885587584 00000100:00100000:0.0:1789498447.852248:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885587712 00000100:00100000:0.0:1789498447.852251:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885587712 00000100:00100000:0.0:1789498447.852267:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789498447.852275:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885587584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498447.852313:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498447.852362:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885587584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498447.852370:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789498447.852393:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789498447.852400:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885587712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498447.852419:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498447.852448:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885587712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498447.852454:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789498447.852489:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb2e1880 x1876424885587712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498447.852509:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885587712:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789498447.852520:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c38000 x1876424885587584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498447.852532:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885587584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498448.722468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498448.722990:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864578816 00000100:00100000:2.0:1789498448.723013:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864578816 00000100:00100000:2.0:1789498448.723077:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 233 00000100:00100000:2.0:1789498448.723114:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:5600:x1876424864578816:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498448.723133:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498448.723155:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498448.723184:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498448.723196:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498448.723206:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25a00, rc 0) 00000100:00100000:2.0:1789498448.723278:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864578816:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 193us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498448.723286:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 233 00000100:00100000:0.0:1789498448.736800:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498448.737336:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864578944 00000100:00100000:3.0:1789498448.737346:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864578944 00000100:00100000:3.0:1789498448.737404:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:3.0:1789498448.737415:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864578944:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498448.737883:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864578944:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 468us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498448.737892:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:1.0:1789498448.743167:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498448.744338:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864579072 00000100:00100000:0.0:1789498448.744351:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864579072 00000100:00100000:0.0:1789498448.744422:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 235 00000100:00100000:0.0:1789498448.744432:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864579072:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498448.744685:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864579072:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 243us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498448.744693:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 235 00000100:00100000:0.0:1789498448.764031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498448.764400:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864579200 00000100:00100000:3.0:1789498448.764411:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864579200 00000100:00100000:3.0:1789498448.764480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 236 00000100:00100000:3.0:1789498448.764491:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864579200:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498448.764511:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498448.764531:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498448.764559:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498448.764572:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498448.764592:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498448.764658:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864579200:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 168us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498448.764665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 236 00000100:00100000:3.0:1789498448.768703:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498448.768828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864579328 00000100:00100000:2.0:1789498448.768840:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864579328 00000100:00100000:2.0:1789498448.768894:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 237 00000100:00100000:2.0:1789498448.768904:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864579328:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498448.769236:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864579328:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 332us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498448.769243:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 237 00000100:00100000:0.0:1789498448.777143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498448.777256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864579456 00000100:00100000:3.0:1789498448.777267:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864579456 00000100:00100000:3.0:1789498448.777318:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 238 00000100:00100000:3.0:1789498448.777329:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864579456:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498448.777696:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864579456:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 367us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498448.777703:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 238 00010000:00010000:1.0:1789498448.821910:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789498449.069183:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789498449.069192:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea891b9000 from 7 10000000:01000000:2.0:1789498449.069197:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789498449.069258:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498449.069271:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498449.069282:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498449.069309:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885587840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498449.069378:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498449.069426:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa055f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498449.070770:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885587840 00000100:00100000:0.0:1789498449.070785:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885587840 00000100:00100000:0.0:1789498449.070866:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789498449.070878:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885587840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498449.070896:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498449.070914:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18298 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.070945:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.070957:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.070967:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640f000, rc 0) 00000100:00100000:0.0:1789498449.071064:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885587840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498449.071071:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789498449.071408:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885587840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498449.071430:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498449.071441:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498449.071527:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885587968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.071562:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498449.071608:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba59d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789498449.071910:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885587968 00000100:00100000:0.0:1789498449.071929:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885587968 00000100:00100000:0.0:1789498449.071968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789498449.071975:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885587968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498449.072478:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885587968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 502us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498449.072486:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789498449.072568:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885587968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.072603:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.072646:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498449.072677:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba59d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498449.072727:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885588096 00000100:00100000:2.0:1789498449.072732:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885588096 00000100:00100000:2.0:1789498449.072764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789498449.072772:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885588096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498449.072930:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885588096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498449.072937:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789498449.073055:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789498449.077506:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789498449.077858:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789498449.077879:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498449.077891:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498449.077904:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498449.077929:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789498449.077932:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eabd51c800 from 7 10000000:01000000:2.0:1789498449.077936:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789498449.077975:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498449.077984:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498449.078004:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498449.078039:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaaca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498449.078128:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498449.078162:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa055fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498449.078377:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885588224 00000100:00100000:0.0:1789498449.078385:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885588224 00000100:00100000:0.0:1789498449.078434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789498449.078444:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885588224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498449.078457:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498449.078470:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc182a6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.078494:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.078505:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.078514:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640fc00, rc 0) 00000100:00100000:0.0:1789498449.078560:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885588224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498449.078567:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789498449.079908:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaaca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498449.079936:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498449.079948:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498449.080051:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.080118:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498449.080149:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba59de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498449.082552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885588352 00000100:00100000:0.0:1789498449.082569:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885588352 00000100:00100000:0.0:1789498449.082629:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789498449.082639:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885588352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498449.082979:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885588352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498449.082997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789498449.083589:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.083634:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.083677:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498449.083707:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba59de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498449.083720:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885588480 00000100:00100000:3.0:1789498449.083724:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885588480 00000100:00100000:3.0:1789498449.083750:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789498449.083757:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885588480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.083911:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885588480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498449.083917:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789498449.083961:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789498449.084986:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789498449.085068:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789498449.085084:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498449.085113:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498449.085124:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498449.085136:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498449.085139:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea90a2f000 from 7 10000000:01000000:3.0:1789498449.085142:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498449.085171:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498449.085180:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498449.085189:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498449.090337:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.090448:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498449.090507:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba59d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498449.090854:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885588608 00000100:00100000:0.0:1789498449.090864:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885588608 00000100:00100000:0.0:1789498449.090920:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789498449.090930:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885588608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498449.090947:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498449.090966:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc182b4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.091006:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.091019:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.091038:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640fa00, rc 0) 00000100:00100000:0.0:1789498449.091135:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885588608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498449.091142:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789498449.091619:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498449.091642:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498449.091653:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498449.091724:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498449.091758:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498449.091792:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498449.091872:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885588736 00000100:00100000:3.0:1789498449.091877:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885588736 00000100:00100000:3.0:1789498449.091958:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789498449.091966:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885588736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498449.092286:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885588736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498449.092294:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789498449.094129:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498449.094189:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498449.094254:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498449.111455:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498449.117654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885588864 00000100:00100000:0.0:1789498449.117676:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885588864 00000100:00100000:0.0:1789498449.117749:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789498449.117763:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885588864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498449.118067:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885588864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (23811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498449.118085:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789498449.118261:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885588864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789498449.119191:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789498449.119585:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789498449.119606:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789498449.119619:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498449.119632:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498449.835233:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498450.859315:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498451.343110:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498451.343203:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498451.343237:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498451.359539:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864579712 00000100:00100000:0.0:1789498451.359556:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864579712 00000100:00100000:0.0:1789498451.360167:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864579840 00000100:00100000:0.0:1789498451.360174:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864579840 00000100:00100000:0.0:1789498451.360209:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:0.0:1789498451.360220:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864579712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498451.360305:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864579712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 87us (17225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498451.360313:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:0.0:1789498451.360332:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:0.0:1789498451.360338:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864579840:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498451.360361:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864579840:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (17124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498451.360366:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:0.0:1789498451.360394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864579584 00000100:00100000:0.0:1789498451.360399:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864579584 00000100:00100000:0.0:1789498451.362737:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 248 00000100:00100000:0.0:1789498451.363126:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864579584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498451.363196:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864579584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 443us (19992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498451.363203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 248 00000100:00080000:0.0:1789498451.363249:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498451.884668:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498452.460021:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885589248:0@lo:400:kworker.0 00000100:00100000:1.0:1789498452.460137:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498452.460197:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498452.460204:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885589376:0@lo:400:kworker.0 00000100:00100000:1.0:1789498452.460231:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498452.460275:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885589248 00000100:00100000:1.0:1789498452.460283:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885589248 00000100:00100000:1.0:1789498452.460340:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789498452.460350:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885589248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498452.460425:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885589248:12345-0@lo:400:kworker.0 Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498452.460433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789498452.460455:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885589376 00000100:00100000:1.0:1789498452.460458:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885589376 00000100:00100000:1.0:1789498452.460487:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789498452.460493:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885589376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498452.460523:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885589376:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498452.460528:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789498452.460543:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498452.460547:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789498452.460830:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba136d80 x1876424885589376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498452.460844:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885589376:0@lo:400:kworker.0 00000100:00100000:1.0:1789498452.460857:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885589248:0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461150:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885588992:0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461193:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498452.461238:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885589504:0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498452.461280:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789498452.461286:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885589120:0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461304:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498452.461317:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885589632:0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461334:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498452.461356:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885589504 00000100:00100000:2.0:1789498452.461361:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885589504 00000100:00100000:2.0:1789498452.461395:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885589120 00000100:00100000:2.0:1789498452.461403:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885589120 00000100:00100000:2.0:1789498452.461435:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789498452.461442:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885589504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461480:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885589504:12345-0@lo:400:kworker.0 Request processed in 38us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498452.461486:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789498452.461500:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789498452.461505:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885589120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461530:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885589120:12345-0@lo:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498452.461535:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789498452.461554:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885589632 00000100:00100000:2.0:1789498452.461558:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885589632 00000100:00100000:2.0:1789498452.461582:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498452.461588:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885589632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461616:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885589632:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498452.461622:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498452.461658:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885589120:0@lo:400:kworker.0 00010000:00080000:2.0:1789498452.461668:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba137b80 x1876424885589632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498452.461677:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885589632:0@lo:400:kworker.0 00000100:00100000:2.0:1789498452.461685:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885589504:0@lo:400:kworker.0 00000100:00100000:3.0:1789498452.462374:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885588992 00000100:00100000:3.0:1789498452.462381:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885588992 00000100:00100000:3.0:1789498452.462422:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789498452.462430:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885588992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498452.462478:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885588992:12345-0@lo:400:kworker.0 Request processed in 49us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498452.462485:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789498452.462521:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885588992:0@lo:400:kworker.0 00000100:00080000:0.0:1789498452.462596:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498452.462602:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498452.912655:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498452.971314:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885589760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498452.971382:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498452.971460:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885589760 00000100:00100000:0.0:1789498452.971467:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885589760 00000100:00100000:0.0:1789498452.971509:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789498452.971516:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885589760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498452.971552:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498452.971714:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885589760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498452.971722:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789498452.971762:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb2e1880 x1876424885589760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498452.971780:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885589760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498452.972000:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885589888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498452.972026:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498452.972144:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885589888 00000100:00100000:3.0:1789498452.972149:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885589888 00000100:00100000:3.0:1789498452.972178:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789498452.972185:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885589888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498452.972207:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498452.972244:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885589888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498452.972250:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789498452.972346:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9c38000 x1876424885589888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498452.972376:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885589888:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789498453.124531:0:11377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789498453.931248:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498454.955752:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498455.979301:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498456.464671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498456.464831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498456.464897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498456.465035:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864579968 00000100:00100000:3.0:1789498456.465045:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864579968 00000100:00100000:3.0:1789498456.465132:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 250 00000100:00100000:3.0:1789498456.465143:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864579968:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498456.465228:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864579968:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 87us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498456.465235:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 250 00000100:00100000:1.0:1789498456.468509:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864580224 00000100:00100000:1.0:1789498456.468525:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864580224 00000100:00080000:0.0:1789498456.468711:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498456.468925:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864580096 00000100:00100000:1.0:1789498456.468934:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864580096 00000100:00100000:1.0:1789498456.469026:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:1.0:1789498456.469041:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864580224:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498456.469160:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864580224:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 120us (4325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498456.469193:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:1.0:1789498456.469223:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:1.0:1789498456.469250:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2357:x1876424864580096:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498456.469277:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2357:x1876424864580096:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (4380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498456.469283:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00080000:0.0:1789498456.469941:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498457.004154:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498457.580527:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885590016:0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.580615:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498457.580668:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885590528:0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.580697:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498457.580725:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789498457.580732:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885590144:0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.580755:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498457.580773:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885590656:0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.580797:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498457.580828:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885590272:0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.580864:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498457.580885:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498457.580891:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885590400:0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.580926:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498457.580962:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885590528 00000100:00100000:0.0:1789498457.580971:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885590528 00000100:00100000:0.0:1789498457.581029:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885590144 00000100:00100000:0.0:1789498457.581048:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885590144 00000100:00100000:0.0:1789498457.581064:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885590272 00000100:00100000:0.0:1789498457.581067:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885590272 00000100:00100000:0.0:1789498457.581086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789498457.581129:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885590528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.581183:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885590528:12345-0@lo:400:kworker.0 Request processed in 56us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498457.581191:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789498457.581210:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789498457.581216:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885590144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.581243:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885590144:12345-0@lo:400:kworker.0 Request processed in 27us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498457.581249:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789498457.581260:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789498457.581265:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885590272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.581298:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885590272:12345-0@lo:400:kworker.0 Request processed in 33us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498457.581304:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789498457.581508:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885590656 00000100:00100000:0.0:1789498457.581512:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885590656 00000100:00100000:0.0:1789498457.581545:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885590400 00000100:00100000:0.0:1789498457.581548:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885590400 00000100:00100000:0.0:1789498457.581570:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789498457.581576:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885590656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.581610:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885590656:12345-0@lo:400:kworker.0 Request processed in 35us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498457.581616:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789498457.581636:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789498457.581641:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885590400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.581670:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885590400:12345-0@lo:400:kworker.0 Request processed in 29us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498457.581676:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789498457.581695:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498457.581699:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498457.581701:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498457.581733:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885590144:0@lo:400:kworker.0 00010000:00080000:0.0:1789498457.581748:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba134000 x1876424885590656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498457.581758:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885590656:0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.581769:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885590528:0@lo:400:kworker.0 00010000:00080000:0.0:1789498457.581805:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba134a80 x1876424885590400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498457.581814:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885590400:0@lo:400:kworker.0 00000100:00100000:0.0:1789498457.581824:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885590272:0@lo:400:kworker.0 00000100:00100000:1.0:1789498457.581925:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885590016 00000100:00100000:1.0:1789498457.581930:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885590016 00000100:00100000:1.0:1789498457.581966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789498457.581974:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea88529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885590016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498457.582013:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea88529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885590016:12345-0@lo:400:kworker.0 Request processed in 40us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498457.582019:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789498457.583300:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885590016:0@lo:400:kworker.0 00000001:02000400:0.0:1789498457.613002:0:11477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:54:15 (1789498455) === 00000100:00100000:2.0:1789498457.849717:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498457.849760:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498457.849804:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864580480 00000100:00100000:2.0:1789498457.849813:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864580480 00000100:00100000:2.0:1789498457.849870:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1789498457.849880:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:9682:x1876424864580480:12345-192.168.201.20@tcp:700:mkdir.0 00000100:00100000:2.0:1789498457.849968:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:9682:x1876424864580480:12345-192.168.201.20@tcp:700:mkdir.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498457.849976:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1789498457.850765:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864580352 00000100:00100000:1.0:1789498457.850773:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864580352 00000100:00100000:1.0:1789498457.850816:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1789498457.850825:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864580352:12345-192.168.201.20@tcp:41:mkdir.0 00000004:00000024:1.0:1789498457.850869:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789498457.851045:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864580352:12345-192.168.201.20@tcp:41:mkdir.0 Request processed in 220us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498457.851052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:2.0:1789498457.857316:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498457.857678:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864580736 00000100:00100000:3.0:1789498457.857688:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864580736 00000100:00100000:3.0:1789498457.857747:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498457.857756:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:9682:x1876424864580736:12345-192.168.201.20@tcp:36:mkdir.0 00010000:00010000:3.0:1789498457.857810:0:7250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498457.857850:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc181a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f2e expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498457.857872:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46e00) 00010000:00010000:3.0:1789498457.857883:0:7250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498457.858237:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498457.858251:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498457.858261:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498457.858331:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498457.858340:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498457.858346:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498457.866374:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789498457.866396:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.866407:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.866415:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.866422:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498457.866673:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.866684:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.866700:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498457.866703:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498457.866708:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.866714:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc182c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498457.866747:0:7250:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdc9afa0 reply state 0000000052349600 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498457.866757:0:7250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498457.866916:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:9682:x1876424864580736:12345-192.168.201.20@tcp:36:mkdir.0 Request processed in 9157us (9604us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789498457.866926:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00010000:00010000:1.0:1789498457.875295:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.875315:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.875323:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.875355:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498457.875360:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.875367:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.875387:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98ea9108ca00) 00010000:00010000:1.0:1789498457.875390:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498457.875396:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.875402:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc182c9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498457.890863:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498457.891042:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864580864 00000100:00100000:0.0:1789498457.891051:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864580864 00000100:00100000:0.0:1789498457.891124:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498457.891136:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:9683:x1876424864580864:12345-192.168.201.20@tcp:101:chmod.0 00010000:00010000:0.0:1789498457.891172:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498457.891198:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab640fe00/0x3a6cb1946bc182d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498457.891268:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab640e000/0x3a6cb1946bc182d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498457.891283:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab640e000/0x3a6cb1946bc182d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498457.891297:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab640e000/0x3a6cb1946bc182d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498457.891350:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498457.891354:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498457.891392:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eab640e000/0x3a6cb1946bc182d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498457.891423:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab640fe00/0x3a6cb1946bc182d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fb3 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498457.891439:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab640e000/0x3a6cb1946bc182d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fb3 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498457.891448:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf500) 00010000:00010000:0.0:1789498457.891450:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498457.891453:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab640e000, rc 0) 00000100:00100000:0.0:1789498457.891511:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:9683:x1876424864580864:12345-192.168.201.20@tcp:101:chmod.0 Request processed in 377us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498457.891518:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:3.0:1789498457.909178:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498457.911171:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864581120 00000100:00100000:2.0:1789498457.911189:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864581120 00000100:00100000:2.0:1789498457.911252:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1789498457.911263:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:9683:x1876424864581120:12345-192.168.201.20@tcp:36:chmod.0 00010000:00010000:2.0:1789498457.911318:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498457.911346:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab640e000/0x3a6cb1946bc182d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fb3 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.911367:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf500) 00010000:00010000:2.0:1789498457.911378:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498457.911404:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.911419:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.911428:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498457.911905:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d491059f reply state 0000000082e95d86 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498457.911923:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789498457.911933:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789498457.912025:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:9683:x1876424864581120:12345-192.168.201.20@tcp:36:chmod.0 Request processed in 763us (2855us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789498457.912032:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00010000:00010000:2.0:1789498457.914073:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.914288:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.914296:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.914303:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498457.914308:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.914317:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.914334:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:2.0:1789498457.914337:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789498457.914342:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498457.914349:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc182de lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498457.953959:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498457.954041:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864581248 00000100:00100000:1.0:1789498457.954052:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864581248 00000100:00100000:1.0:1789498457.954144:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:1.0:1789498457.954156:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:9684:x1876424864581248:12345-192.168.201.20@tcp:101:chown.0 00010000:00010000:1.0:1789498457.954182:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498457.954207:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc182e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fba expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.954280:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc182ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.954295:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc182ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.954307:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc182ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498457.954366:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789498457.954370:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498457.954416:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc182ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.954659:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc182e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fba expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.954678:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc182ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fba expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.954687:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1900) 00010000:00010000:1.0:1789498457.954690:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498457.954694:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddec00, rc 0) 00000100:00100000:1.0:1789498457.954761:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:9684:x1876424864581248:12345-192.168.201.20@tcp:101:chown.0 Request processed in 607us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498457.954768:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:0.0:1789498457.956869:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498457.956933:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864581376 00000100:00100000:1.0:1789498457.956944:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864581376 00000100:00100000:1.0:1789498457.957003:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:1.0:1789498457.957011:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:9684:x1876424864581376:12345-192.168.201.20@tcp:101:chown.0 00010000:00010000:1.0:1789498457.957030:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498457.957047:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc182f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fc1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957132:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957164:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957175:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957191:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957198:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957205:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957296:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957304:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957311:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498457.957343:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789498457.957348:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498457.957367:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957378:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957394:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957400:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957406:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498457.957410:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957418:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957503:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1900) 00010000:00010000:1.0:1789498457.957507:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498457.957513:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957519:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc182fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957531:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957538:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957656:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957663:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498457.957673:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957680:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957688:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98ea930e1d00) 00010000:00010000:1.0:1789498457.957691:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498457.957694:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957699:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18301 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957731:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc182f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fc1 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957745:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fc1 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.957753:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea930e1100) 00010000:00010000:1.0:1789498457.957755:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498457.957758:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddfc00, rc 0) 00000100:00100000:1.0:1789498457.957814:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:9684:x1876424864581376:12345-192.168.201.20@tcp:101:chown.0 Request processed in 802us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498457.957821:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:0.0:1789498457.962596:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498457.962733:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864581632 00000100:00100000:1.0:1789498457.962745:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864581632 00000100:00100000:1.0:1789498457.962809:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:1.0:1789498457.962820:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:9684:x1876424864581632:12345-192.168.201.20@tcp:36:chown.0 00010000:00010000:1.0:1789498457.962900:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498457.962927:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fc1 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.962947:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea930e1100) 00010000:00010000:1.0:1789498457.962959:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498457.962987:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.963003:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498457.963014:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.027679:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789498458.038221:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789498458.038374:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002607a1a5 reply state 0000000084519bfd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498458.038390:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789498458.038405:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789498458.038687:0:5847:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789498458.038704:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:9684:x1876424864581632:12345-192.168.201.20@tcp:36:chown.0 Request processed in 75882us (76113us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789498458.038713:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00010000:00010000:1.0:1789498458.039216:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.039228:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.039236:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.039241:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498458.039246:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.039254:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.039282:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea930e1000) 00010000:00010000:1.0:1789498458.039285:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789498458.039291:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.039297:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1830f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498458.073605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498458.073700:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864581760 00000100:00100000:3.0:1789498458.073710:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864581760 00000100:00080000:0.0:1789498458.073778:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498458.073793:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:3.0:1789498458.073805:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:9685:x1876424864581760:12345-192.168.201.20@tcp:101:touch.500 00010000:00010000:3.0:1789498458.073836:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498458.073856:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fc8 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789498458.077137:0:7250:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3232us 00000100:00100000:2.0:1789498458.091772:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885590784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498458.091854:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498458.094768:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885590912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498458.094852:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498458.095046:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885590784 00000100:00100000:0.0:1789498458.095055:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885590784 00000100:00100000:0.0:1789498458.095285:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885590912 00000100:00100000:0.0:1789498458.095289:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885590912 00000100:00100000:0.0:1789498458.095309:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789498458.095400:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789498458.095419:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885590912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498458.095647:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498458.095703:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885590912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 296us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498458.095710:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789498458.095751:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba135880 x1876424885590912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498458.095772:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885590912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498458.095886:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885590784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498458.095910:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498458.095946:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885590784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 630us (4092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498458.095952:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789498458.098964:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea8535c700 x1876424885590784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498458.098992:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885590784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789498458.110566:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.110589:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.110610:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.110626:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.110634:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.110640:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.110998:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1832b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111008:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1832b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111016:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1832b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498458.111043:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498458.111046:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498458.111123:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1832b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111406:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111413:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111501:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111508:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498458.111513:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111521:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111533:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1900) 00010000:00010000:0.0:1789498458.111536:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498458.111541:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111548:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1831d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111561:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111567:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111573:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111578:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498458.111580:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111596:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111604:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98ea84ebf900) 00010000:00010000:0.0:1789498458.111606:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498458.111609:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111614:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18324 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111652:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fc8 expref: 8 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111668:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1832b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fc8 expref: 7 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.111675:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498458.111677:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789498458.111679:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4e00, rc 0) 00000100:00100000:0.0:1789498458.112239:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:9685:x1876424864581760:12345-192.168.201.20@tcp:101:touch.500 Request processed in 38430us (38829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498458.112250:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:0.0:1789498458.120345:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498458.120436:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864582016 00000100:00100000:1.0:1789498458.120447:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864582016 00000100:00100000:1.0:1789498458.120503:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1789498458.120518:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:9685:x1876424864582016:12345-192.168.201.20@tcp:101:touch.500 00010000:00010000:1.0:1789498458.120541:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498458.120560:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18332 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fcf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.120843:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.120858:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.120870:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.120909:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.120916:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.120923:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789498458.122580:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789498458.122892:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.122908:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.122918:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.122953:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.122969:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.123683:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.123694:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498458.123699:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.123706:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.123718:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:1.0:1789498458.123721:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498458.123725:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.123731:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18339 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498458.123748:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff0ae4ce reply state 00000000e6936ec5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498458.123756:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789498458.123888:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18332 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fcf expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.123908:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fcf expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.123931:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98ea930e1100) 00010000:00010000:1.0:1789498458.123933:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498458.123936:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddee00, rc 0) 00000100:00100000:1.0:1789498458.128216:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:9685:x1876424864582016:12345-192.168.201.20@tcp:101:touch.500 Request processed in 7690us (7867us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789498458.128229:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1789498458.151292:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:2.0:1789498458.151609:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.151622:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.151630:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.151637:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498458.151642:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.151650:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.151666:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff98ea930e1000) 00010000:00010000:2.0:1789498458.151670:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498458.151675:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.151681:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc18340 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498458.153528:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864582272 00000100:00100000:3.0:1789498458.153577:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864582272 00000100:00100000:3.0:1789498458.153667:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1789498458.153678:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:9685:x1876424864582272:12345-192.168.201.20@tcp:36:touch.500 00010000:00010000:3.0:1789498458.153785:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498458.153836:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fcf expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.153872:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98ea930e1100) 00010000:00010000:3.0:1789498458.154403:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498458.154453:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.154467:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.154477:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498458.154630:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f21790b9 reply state 00000000d90a75d7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498458.154640:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498458.154961:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:9685:x1876424864582272:12345-192.168.201.20@tcp:36:touch.500 Request processed in 1283us (3677us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789498458.154969:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00010000:00010000:1.0:1789498458.158702:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.158720:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.158729:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.158735:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498458.158740:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.158747:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.158764:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98ea9108c100) 00010000:00010000:1.0:1789498458.158767:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498458.158772:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498458.158779:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18355 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498458.160703:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498458.160780:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864582400 00000100:00100000:0.0:1789498458.160792:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864582400 00000100:00100000:0.0:1789498458.160862:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:0.0:1789498458.160872:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:9685:x1876424864582400:12345-192.168.201.20@tcp:101:touch.500 00010000:00010000:0.0:1789498458.160918:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498458.160943:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1835c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fd6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.162229:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1835c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fd6 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.162251:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1835c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fd6 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.162275:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98ea84ebf900) 00010000:00010000:0.0:1789498458.162278:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498458.162282:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4200, rc 0) 00000100:00100000:0.0:1789498458.162358:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:9685:x1876424864582400:12345-192.168.201.20@tcp:101:touch.500 Request processed in 1486us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498458.162367:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:0.0:1789498458.172297:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498458.172394:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864582528 00000100:00100000:1.0:1789498458.172405:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864582528 00000100:00100000:1.0:1789498458.172463:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:1.0:1789498458.172472:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1876424864582528:12345-192.168.201.20@tcp:8:touch.500 00010000:00080000:1.0:1789498458.172506:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:1.0:1789498458.172544:0:6701:0:(genops.c:1384:class_connect()) connect: client 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c, cookie 0x3a6cb1946bc18363 00002000:00100000:1.0:1789498458.172555:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c/ffff98eababdb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789498458.172568:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789498458.172937:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789498458.173062:0:6701:0:(import.c:65:import_set_state_nolock()) ffff98ea857a2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498458.173772:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2354:x1876424864582528:12345-192.168.201.20@tcp:8:touch.500 Request processed in 835us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498458.173782:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:3.0:1789498458.182184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498458.182856:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864582656 00000100:00100000:1.0:1789498458.182868:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864582656 00000100:00100000:1.0:1789498458.182947:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:1.0:1789498458.182958:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:0:x1876424864582656:12345-192.168.201.20@tcp:2:touch.500 00000100:00080000:0.0:1789498458.183304:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789498458.258398:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1789498458.258414:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000100:00100000:2.0:1789498458.258620:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:0:x1876424864582656:12345-192.168.201.20@tcp:2:touch.500 Request processed in 75658us (76440us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789498458.258645:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1789498458.262415:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498458.262628:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864582912 00000100:00100000:1.0:1789498458.262639:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864582912 00000100:00100000:1.0:1789498458.262707:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:1.0:1789498458.262717:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:9685:x1876424864582912:12345-192.168.201.20@tcp:35:touch.500 00000100:00100000:1.0:1789498458.263407:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:9685:x1876424864582912:12345-192.168.201.20@tcp:35:touch.500 Request processed in 657us (967us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789498458.263433:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1789498458.291030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498458.291219:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864583040 00000100:00100000:0.0:1789498458.291230:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864583040 00000100:00100000:0.0:1789498458.291291:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1789498458.291302:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:9686:x1876424864583040:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1789498458.291329:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498458.291352:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1836a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fdd expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.291437:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.291467:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.291480:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498458.291524:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498458.291527:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498458.291566:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.291593:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1836a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fdd expref: 13 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.291611:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fdd expref: 12 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.291619:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498458.291622:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498458.291625:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5000, rc 0) 00000100:00100000:0.0:1789498458.291836:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:9686:x1876424864583040:12345-192.168.201.20@tcp:101:rm.0 Request processed in 536us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498458.291844:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:3.0:1789498458.299930:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498458.300478:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864583296 00000100:00100000:0.0:1789498458.300490:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864583296 00000100:00100000:0.0:1789498458.300606:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:0.0:1789498458.300618:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:9686:x1876424864583296:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1789498458.300640:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498458.300691:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc18378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99fe4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498458.300793:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789498458.300973:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc18378 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fe4 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.300995:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1900) 00010000:00010000:0.0:1789498458.300998:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789498458.301004:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc18378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fe4 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.301017:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5600, rc 0) 00000100:00100000:0.0:1789498458.301259:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:9686:x1876424864583296:12345-192.168.201.20@tcp:101:rm.0 Request processed in 642us (1345us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789498458.301266:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:1.0:1789498458.309429:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498458.309604:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864583424 00000100:00100000:2.0:1789498458.309615:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864583424 00000100:00100000:2.0:1789498458.309679:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:2.0:1789498458.309689:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:9686:x1876424864583424:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1789498458.316704:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:9686:x1876424864583424:12345-192.168.201.20@tcp:37:rm.0 Request processed in 7004us (7284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498458.316720:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:0.0:1789498458.323113:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498458.323239:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864583680 00000100:00100000:3.0:1789498458.323250:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864583680 00000100:00100000:3.0:1789498458.323320:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498458.323330:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5956850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:9686:x1876424864583680:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:3.0:1789498458.323606:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5956850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:9686:x1876424864583680:12345-192.168.201.20@tcp:35:rm.0 Request processed in 276us (521us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789498458.323613:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1789498458.328150:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498458.328338:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864583936 00000100:00100000:3.0:1789498458.328349:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864583936 00000100:00100000:3.0:1789498458.328425:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1789498458.328436:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:9686:x1876424864583936:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1789498458.328474:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498458.328496:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99feb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.328611:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc1838d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.328626:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc1838d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.328637:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc1838d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498458.328648:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789498458.328786:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99feb expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.328806:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc1838d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99feb expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.328814:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:3.0:1789498458.328817:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789498458.328837:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db000, rc 0) 00000100:00100000:3.0:1789498458.328902:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:9686:x1876424864583936:12345-192.168.201.20@tcp:101:rm.0 Request processed in 469us (761us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789498458.328937:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1789498458.333916:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498458.334759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864584064 00000100:00100000:1.0:1789498458.334772:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864584064 00000100:00100000:1.0:1789498458.334884:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:1.0:1789498458.334896:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:9686:x1876424864584064:12345-192.168.201.20@tcp:41:rm.0 00000004:00000024:1.0:1789498458.334967:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789498458.335061:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:9686:x1876424864584064:12345-192.168.201.20@tcp:41:rm.0 Request processed in 167us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498458.335069:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:0.0:1789498458.338125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498458.338266:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864584192 00000100:00100000:3.0:1789498458.338277:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864584192 00000100:00100000:3.0:1789498458.338338:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1789498458.338349:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:9686:x1876424864584192:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1789498458.338369:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498458.338391:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1839b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99ff2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338471:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338486:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338498:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338514:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338521:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338527:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338628:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc183b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338654:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc183b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338661:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc183b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498458.338692:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789498458.338696:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498458.338712:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc183b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338723:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc183b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338731:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338737:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338744:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338750:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498458.338754:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338762:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338773:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:3.0:1789498458.338776:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498458.338787:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338794:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc183a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338809:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338815:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338831:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338836:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498458.338839:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338845:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338853:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff98ea9108c600) 00010000:00010000:3.0:1789498458.338855:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498458.338857:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338863:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc183a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338896:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1839b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ff2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338921:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc183b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ff2 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.338929:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98ea84ebf900) 00010000:00010000:3.0:1789498458.338931:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498458.338933:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80031600, rc 0) 00000100:00100000:3.0:1789498458.339019:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:9686:x1876424864584192:12345-192.168.201.20@tcp:101:rm.0 Request processed in 672us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498458.339026:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1789498458.346718:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498458.347134:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864584448 00000100:00100000:0.0:1789498458.347145:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864584448 00000100:00100000:0.0:1789498458.347196:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:0.0:1789498458.347205:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:9686:x1876424864584448:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1789498458.347262:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789498458.347289:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc183b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ff2 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347325:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1835c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fd6 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347355:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98ea84ebf900) 00010000:00010000:0.0:1789498458.347374:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fdd expref: 15 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347382:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498458.347385:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498458.347417:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347431:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347441:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347454:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347795:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347803:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347931:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347939:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.347958:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498458.350867:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789498458.350888:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358114797059ns, next at 359114793563ns, rc = 0 00010000:00010000:2.0:1789498458.350985:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351001:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351012:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351022:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351029:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351053:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351178:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498458.351204:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351210:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351216:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351222:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498458.351226:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351233:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351246:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:2.0:1789498458.351249:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789498458.351254:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351260:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc183c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351280:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351287:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351299:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351304:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498458.351307:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351379:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351389:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:2.0:1789498458.351400:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498458.351404:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.351409:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc183b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498458.351420:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090c8783d reply state 0000000073f272a6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498458.351429:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498458.351579:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:9686:x1876424864584448:12345-192.168.201.20@tcp:36:rm.0 Request processed in 4370us (4866us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789498458.351587:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00010000:00010000:3.0:1789498458.353941:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498458.353954:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.353963:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498458.353968:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.353977:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.353993:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:3.0:1789498458.353996:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789498458.354000:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.354006:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc183cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.354027:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498458.354042:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498458.354044:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498458.354388:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.354519:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.354526:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.354531:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498458.354535:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.354611:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.354622:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff98ea84ebf600) 00010000:00010000:0.0:1789498458.354624:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498458.354627:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498458.354632:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc183be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498458.357693:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498458.357962:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864584704 00000100:00100000:3.0:1789498458.357973:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864584704 00000100:00100000:3.0:1789498458.358030:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:3.0:1789498458.358040:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:9686:x1876424864584704:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:3.0:1789498458.358326:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:9686:x1876424864584704:12345-192.168.201.20@tcp:35:rm.0 Request processed in 286us (642us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789498458.358334:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:2.0:1789498458.366738:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498458.366905:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864584960 00000100:00100000:3.0:1789498458.366917:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864584960 00000100:00100000:3.0:1789498458.366986:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1789498458.366997:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:9686:x1876424864584960:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:3.0:1789498458.367058:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789498458.367086:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc1838d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99feb expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367151:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1832b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fc8 expref: 15 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367161:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:3.0:1789498458.367177:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc182ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fba expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367186:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1900) 00010000:00010000:3.0:1789498458.367193:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498458.367215:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367237:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367249:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367263:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367270:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367276:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367542:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367551:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.367558:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498458.368353:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789498458.368370:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.368378:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.368384:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.368397:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498458.368401:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.368409:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.368420:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98ea9108c000) 00010000:00010000:3.0:1789498458.368423:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789498458.368427:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.368433:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030200/0x3a6cb1946bc183e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.369032:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.369044:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.369051:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.369056:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498458.369059:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.369066:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.369134:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:3.0:1789498458.369137:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498458.369141:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498458.369148:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc183d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498458.369163:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b48b379e reply state 000000006209a47d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498458.369173:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498458.369441:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:9686:x1876424864584960:12345-192.168.201.20@tcp:36:rm.0 Request processed in 2441us (2709us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789498458.369469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00010000:00010000:2.0:1789498458.376174:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.376193:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.376202:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.376208:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498458.376214:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.376223:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.376241:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98ea9108cb00) 00010000:00010000:2.0:1789498458.376244:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498458.376249:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498458.376254:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc183da lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498459.051955:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498460.075563:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498461.102443:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498461.583580:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498461.587975:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498461.588005:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498461.588032:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498461.588074:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864585216 00000100:00100000:3.0:1789498461.588085:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864585216 00000100:00100000:3.0:1789498461.588161:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864585472 00000100:00100000:3.0:1789498461.588165:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864585472 00000100:00100000:3.0:1789498461.588187:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 110 00000100:00100000:3.0:1789498461.588196:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2357:x1876424864585216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498461.588272:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2357:x1876424864585216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498461.588280:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 110 00000100:00100000:3.0:1789498461.588297:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 111 00000100:00100000:3.0:1789498461.588315:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864585472:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498461.588339:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864585472:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498461.588346:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 111 00000100:00100000:3.0:1789498461.588364:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864585088 00000100:00100000:3.0:1789498461.588367:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864585088 00000100:00100000:3.0:1789498461.588397:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 252 00000100:00100000:3.0:1789498461.588404:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864585088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498461.588432:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864585088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498461.588438:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 252 00000100:00100000:3.0:1789498461.588462:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864585344 00000100:00100000:3.0:1789498461.588465:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864585344 00000100:00100000:3.0:1789498461.588490:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:3.0:1789498461.588496:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864585344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498461.588519:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864585344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498461.588525:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00080000:3.0:1789498461.588540:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498461.588545:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498462.123266:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498462.699604:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885591168:0@lo:400:kworker.0 00000100:00100000:1.0:1789498462.699676:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498462.699751:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885591680:0@lo:400:kworker.0 00000100:00100000:1.0:1789498462.699778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498462.699809:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789498462.699815:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885591040:0@lo:400:kworker.0 00000100:00100000:1.0:1789498462.699844:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498462.699864:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885591552:0@lo:400:kworker.0 00000100:00100000:1.0:1789498462.699885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498462.699910:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885591424:0@lo:400:kworker.0 00000100:00100000:1.0:1789498462.699932:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498462.699947:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498462.699952:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885591296:0@lo:400:kworker.0 00000100:00100000:1.0:1789498462.699972:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498462.700172:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885591680 00000100:00100000:2.0:1789498462.700180:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885591680 00000100:00100000:2.0:1789498462.700239:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885591424 00000100:00100000:2.0:1789498462.700243:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885591424 00000100:00100000:2.0:1789498462.700264:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789498462.700272:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885591680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498462.700352:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885591680:12345-0@lo:400:kworker.0 Request processed in 79us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498462.700360:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789498462.700377:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498462.700383:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885591424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498462.700412:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885591424:12345-0@lo:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498462.700418:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789498462.700450:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba131880 x1876424885591680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498462.700463:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885591680:0@lo:400:kworker.0 00000100:00100000:0.0:1789498462.700603:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885591040 00000100:00100000:0.0:1789498462.700609:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885591040 00000100:00100000:0.0:1789498462.700646:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789498462.700653:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885591040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498462.700697:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885591040:12345-0@lo:400:kworker.0 Request processed in 45us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498462.700704:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789498462.700841:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885591040:0@lo:400:kworker.0 00000100:00080000:1.0:1789498462.700902:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498462.700908:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789498462.700926:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba131c00 x1876424885591424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498462.700936:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885591424:0@lo:400:kworker.0 00000100:00100000:3.0:1789498462.701005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885591168 00000100:00100000:3.0:1789498462.701009:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885591168 00000100:00100000:3.0:1789498462.701043:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885591552 00000100:00100000:3.0:1789498462.701046:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885591552 00000100:00100000:3.0:1789498462.701069:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885591296 00000100:00100000:3.0:1789498462.701072:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885591296 00000100:00100000:3.0:1789498462.701130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789498462.701136:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885591168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498462.701176:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885591168:12345-0@lo:400:kworker.0 Request processed in 40us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498462.701182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789498462.701195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789498462.701201:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885591552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498462.701227:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885591552:12345-0@lo:400:kworker.0 Request processed in 26us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498462.701232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789498462.701243:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789498462.701249:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885591296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498462.701277:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885591296:12345-0@lo:400:kworker.0 Request processed in 28us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498462.701282:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1789498462.701440:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498462.701461:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885591296:0@lo:400:kworker.0 00000100:00100000:0.0:1789498462.703873:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885591552:0@lo:400:kworker.0 00000100:00100000:0.0:1789498462.703894:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885591168:0@lo:400:kworker.0 00010000:00010000:3.0:1789498463.147574:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789498463.211360:0:8000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362975266198ns, next at 363975264007ns, rc = 0 00000100:00100000:3.0:1789498463.211417:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498463.211444:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885591808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498463.211517:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498463.211628:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885591808 00000100:00100000:1.0:1789498463.211637:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885591808 00000100:00100000:1.0:1789498463.211691:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789498463.211702:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885591808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498463.211752:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498463.211811:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885591808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498463.211830:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789498463.211878:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba135f80 x1876424885591808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498463.211899:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885591808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498463.214195:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498463.214220:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885591936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498463.214295:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498463.214342:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885591936 00000100:00100000:3.0:1789498463.214351:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885591936 00000100:00100000:3.0:1789498463.214407:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789498463.214418:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885591936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498463.214453:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498463.214503:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885591936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498463.214526:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789498463.214570:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba8f6d80 x1876424885591936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498463.214591:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885591936:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789498463.339630:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000004:00080000:0.0:1789498463.341524:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789498463.341570:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1789498463.341579:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789498463.341592:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1789498463.341869:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885592064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789498463.341953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498463.342553:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885592064 00000100:00100000:2.0:1789498463.342568:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885592064 00000100:00100000:2.0:1789498463.342763:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789498463.342778:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885592064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789498463.342815:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789498463.343129:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa99459, atime: 0x6aa99459, ctime: 0x6aa99459, blocks: 0x1 00010000:00010000:2.0:1789498463.343139:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498463.343156:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1789498463.343174:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498463.343182:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498463.343200:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498463.343211:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498463.343219:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498463.343396:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789498463.344024:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885592064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1250us (2070us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789498463.344033:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1789498463.353332:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eaba8f7b80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789498463.353351:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885592064:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789498463.356699:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498463.356717:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498463.356740:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498463.356746:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498463.356759:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498463.356789:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498463.356816:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067f051df/0x3a6cb1946bc183e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498463.356901:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498463.356903:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498463.356905:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789498463.908071:0:11628:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1789498464.182153:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498465.201929:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789498465.289274:0:11677:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8bcec940 20000000:00000080:2.0:1789498465.289295:0:11677:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98ea8471f800 uarg=0000000000000000 20000000:01000000:2.0:1789498465.289332:0:11677:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789498465.289338:0:11677:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789498465.289343:0:11677:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789498465.291383:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789498465.291589:0:11677:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789498465.294948:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789498465.295005:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789498465.295058:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789498465.295076:0:11677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789498465.295135:0:11677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.295157:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.295166:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.295174:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.295181:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.295188:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.295204:0:11677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.295246:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.295263:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 18 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498465.295278:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592192:0@lo:104: 00000100:00100000:0.0:1789498465.295340:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498465.295405:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885592192 00010000:00010000:0.0:1789498465.295407:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498465.295415:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885592192 00010000:00010000:0.0:1789498465.295419:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 18 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498465.295429:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592320:0@lo:104: 00000100:00100000:0.0:1789498465.295451:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498465.305567:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885592320 00000100:00100000:2.0:1789498465.305583:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885592320 00000100:00100000:2.0:1789498465.305641:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789498465.305651:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:11677:x1876424885592192:12345-0@lo:104: 00010000:00010000:2.0:1789498465.305681:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498465.305831:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498465.305848:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+4:11677:x1876424885592192:12345-0@lo:104: Request processed in 188us (10497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498465.305856:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789498465.305876:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789498465.305884:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:11677:x1876424885592320:12345-0@lo:104: 00010000:00010000:2.0:1789498465.305891:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306305:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789498465.306314:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306332:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498465.306336:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306344:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498465.306351:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498465.306356:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789498465.306398:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306404:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498465.306431:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306438:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20da800/0x3a6cb1946bc182b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc182bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306453:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498465.306456:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306461:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498465.306464:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306488:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498465.306495:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498465.306501:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789498465.306512:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306517:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498465.306529:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306535:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc182a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc182ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306543:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498465.306545:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498465.306547:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498465.306554:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498465.306568:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885592448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498465.306604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498465.306635:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498465.306642:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885592576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498465.306659:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498465.306679:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885592448 00000100:00100000:1.0:1789498465.306683:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885592448 00010000:00010000:1.0:1789498465.306719:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 19 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498465.306741:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885592576 00000100:00100000:1.0:1789498465.306743:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885592576 00010000:00010000:1.0:1789498465.306754:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 20 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498465.306764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789498465.306770:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3305:x1876424885592448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498465.306780:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498465.306784:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 20 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306794:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 20 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306811:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498465.306835:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3305:x1876424885592448:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498465.306841:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789498465.306852:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789498465.306857:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885592576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498465.306863:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498465.306867:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 19 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306875:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 19 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.306884:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498465.306908:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885592576:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498465.306914:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789498465.306942:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885592576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498465.306959:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885592448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498465.306988:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.307001:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 18 pid: 5840 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498465.307010:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592704:0@lo:104: 00000100:00100000:1.0:1789498465.307032:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498465.307055:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789498465.307065:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789498465.307069:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789498465.307190:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.307200:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 12 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498465.307209:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592832:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498465.307356:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.307364:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498465.307384:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592960:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498465.307407:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa07a2600 going to sleep for 11 seconds 00010000:00010000:1.0:1789498465.307420:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640fa00/0x3a6cb1946bc182bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc182b4 expref: 18 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498465.307432:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592192:0@lo:104: 00010000:00010000:1.0:1789498465.307439:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640fc00/0x3a6cb1946bc182ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc182a6 expref: 17 pid: 5837 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498465.307447:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592320:0@lo:104: 00010000:00010000:2.0:1789498465.307866:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789498465.307875:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:11677:x1876424885592320:12345-0@lo:104: Request processed in 1992us (12422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498465.307882:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498465.307971:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885592704 00000100:00100000:3.0:1789498465.307978:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885592704 00000100:00100000:3.0:1789498465.308008:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498465.308015:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8910f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:11677:x1876424885592704:12345-0@lo:104: 00010000:00010000:3.0:1789498465.308025:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498465.308110:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789498465.308115:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8910f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec95aa81-4721-4a06-ac30-039c6a8f6732+3:11677:x1876424885592704:12345-0@lo:104: Request processed in 101us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498465.308121:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789498465.308159:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498465.308164:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498465.308171:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25800 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498465.308175:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498465.308183:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498465.308202:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498465.308207:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789498465.308234:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498465.308240:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498465.308257:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498465.308263:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad25800/0x3a6cb1946bc18298 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1829f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498465.308276:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498465.308277:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498465.308279:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498465.308295:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885593088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498465.308327:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498465.308368:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885593088 00000100:00100000:3.0:1789498465.308372:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885593088 00010000:00010000:3.0:1789498465.308387:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 17 pid: 5840 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498465.308407:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498465.308413:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85660850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:3308:x1876424885593088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498465.308423:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498465.308428:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 17 pid: 5840 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498465.308442:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 17 pid: 5840 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498465.308456:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498465.308560:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85660850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:3308:x1876424885593088:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498465.308567:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498465.308624:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885593088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498465.308708:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498465.308790:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640f000/0x3a6cb1946bc1829f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc18298 expref: 16 pid: 5840 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498465.308801:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592704:0@lo:104: 00000100:00100000:3.0:1789498465.316791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498465.316893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864585600 00000100:00100000:0.0:1789498465.316905:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864585600 00010000:00010000:0.0:1789498465.316948:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 13 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498465.316988:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:0.0:1789498465.316997:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864585600:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498465.317012:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498465.317032:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 13 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.317046:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 13 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.317065:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498465.317156:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864585600:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 159us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498465.317163:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00010000:00010000:2.0:1789498465.317809:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac20dbe00/0x3a6cb1946bc18291 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fac expref: 12 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498465.317827:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592832:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498465.317839:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1876424885592960:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498465.317877:0:11677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498465.319579:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498465.319662:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864585728 00000100:00100000:0.0:1789498465.319672:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864585728 00010000:00010000:0.0:1789498465.319724:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498465.319767:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:0.0:1789498465.319778:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:2355:x1876424864585728:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498465.319794:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498465.319800:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319811:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319828:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad25a00/0x3a6cb1946bc1828a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99fa5 expref: 12 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319855:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319882:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319902:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319909:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319916:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319923:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319928:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498465.319933:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319941:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319961:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498465.319972:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498465.320024:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:2355:x1876424864585728:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 248us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498465.320031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00010000:00010000:1.0:1789498465.320184:0:11677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.320197:0:11677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498465.320203:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc183ef lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498466.219264:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498466.708937:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498466.708999:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498466.709042:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498466.709082:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498466.709207:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864585984 00000100:00100000:1.0:1789498466.709217:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864585984 00000100:00100000:1.0:1789498466.709280:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864586240 00000100:00100000:1.0:1789498466.709283:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864586240 00000100:00100000:1.0:1789498466.709305:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 115 00000100:00100000:1.0:1789498466.709314:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864585984:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498466.709387:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864585984:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498466.709406:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 115 00000100:00100000:1.0:1789498466.709424:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1789498466.709430:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864586240:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498466.709471:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864586240:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498466.709477:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00080000:0.0:1789498466.709586:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498466.709680:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864585856 00000100:00100000:3.0:1789498466.709682:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864586112 00000100:00100000:2.0:1789498466.709686:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864585856 00000100:00100000:3.0:1789498466.709690:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864586112 00000100:00100000:2.0:1789498466.709736:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 254 00000100:00100000:3.0:1789498466.709746:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:2.0:1789498466.709748:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea88528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:2355:x1876424864585856:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498466.709760:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864586112:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498466.709784:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea88528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:2355:x1876424864585856:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498466.709792:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 254 00000100:00100000:3.0:1789498466.709798:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864586112:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498466.709805:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00080000:0.0:1789498466.709994:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498467.086389:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498467.086551:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864586368 00000100:00100000:2.0:1789498467.086561:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864586368 00000100:00100000:2.0:1789498467.086769:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 255 00000100:00100000:2.0:1789498467.086780:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8852a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:5600:x1876424864586368:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498467.086798:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498467.086819:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad24800/0x3a6cb1946bc183f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a99ff9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.086849:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad24800/0x3a6cb1946bc183f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ff9 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.086861:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad24800/0x3a6cb1946bc183f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ff9 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.086870:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24800, rc 0) 00000100:00100000:2.0:1789498467.087226:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8852a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864586368:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 447us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.087233:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 255 00000100:00100000:3.0:1789498467.094442:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498467.102141:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864586496 00000100:00100000:1.0:1789498467.102160:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864586496 00000100:00100000:1.0:1789498467.103059:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 256 00000100:00100000:1.0:1789498467.103076:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864586496:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498467.103500:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864586496:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 429us (9065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498467.103509:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 256 00000100:00100000:0.0:1789498467.116706:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498467.116836:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864586624 00000100:00100000:2.0:1789498467.116861:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864586624 00000100:00100000:2.0:1789498467.116938:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 257 00000100:00100000:2.0:1789498467.116948:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864586624:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.117203:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864586624:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 254us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.117211:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 257 00000100:00100000:2.0:1789498467.129084:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498467.135958:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864586752 00000100:00100000:1.0:1789498467.135983:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864586752 00000100:00100000:1.0:1789498467.136064:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 258 00000100:00100000:1.0:1789498467.136076:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:9958:x1876424864586752:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498467.136385:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:9958:x1876424864586752:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 310us (7310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498467.136392:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 258 00000100:00100000:0.0:1789498467.144880:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498467.145187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864586880 00000100:00100000:3.0:1789498467.145199:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864586880 00000100:00100000:3.0:1789498467.145273:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 259 00000100:00100000:3.0:1789498467.145283:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:9958:x1876424864586880:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789498467.150390:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:9958:x1876424864586880:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 1760us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498467.150429:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 259 00000100:00100000:0.0:1789498467.160023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498467.160185:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864587008 00000100:00100000:2.0:1789498467.160196:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864587008 00000100:00100000:2.0:1789498467.160248:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 260 00000100:00100000:2.0:1789498467.160257:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:5600:x1876424864587008:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498467.160286:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498467.160305:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad24c00/0x3a6cb1946bc183fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a000 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.160332:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad24c00/0x3a6cb1946bc183fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a000 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.160344:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad24c00/0x3a6cb1946bc183fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a000 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.160352:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24c00, rc 0) 00000100:00100000:2.0:1789498467.160413:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864587008:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 156us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.160420:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 260 00000100:00100000:2.0:1789498467.163454:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498467.168464:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864587136 00000100:00100000:0.0:1789498467.168481:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864587136 00000100:00100000:0.0:1789498467.168544:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 261 00000100:00100000:0.0:1789498467.168553:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864587136:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498467.169192:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864587136:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 636us (5744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498467.169200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 261 00000100:00100000:0.0:1789498467.173592:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498467.173834:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864587264 00000100:00100000:1.0:1789498467.173846:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864587264 00000100:00100000:1.0:1789498467.173961:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 262 00000100:00100000:1.0:1789498467.173983:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864587264:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498467.174274:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:5600:x1876424864587264:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 284us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498467.174282:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 262 00000100:00100000:1.0:1789498467.186544:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498467.186906:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864587392 00000100:00100000:0.0:1789498467.186917:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864587392 00000100:00100000:0.0:1789498467.187060:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 263 00000100:00100000:0.0:1789498467.187071:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:9961:x1876424864587392:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498467.188198:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:9961:x1876424864587392:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 1123us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498467.188209:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 263 00000100:00100000:3.0:1789498467.205262:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498467.205379:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864587520 00000100:00100000:1.0:1789498467.205391:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864587520 00000100:00100000:1.0:1789498467.205451:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 264 00000100:00100000:1.0:1789498467.205462:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:9961:x1876424864587520:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498467.205860:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:9961:x1876424864587520:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 397us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498467.205869:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 264 00010000:00010000:1.0:1789498467.248556:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789498467.257587:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789498467.257595:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea891b9000 from 7 10000000:01000000:0.0:1789498467.257601:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498467.257670:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498467.257682:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498467.257693:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498467.257721:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498467.257805:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498467.257872:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498467.258017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885593216 00000100:00100000:3.0:1789498467.258026:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885593216 00000100:00100000:3.0:1789498467.258080:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789498467.258122:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:5842:x1876424885593216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498467.258137:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498467.259136:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad25600/0x3a6cb1946bc1840b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18404 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.259187:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad25600/0x3a6cb1946bc1840b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18404 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.259200:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad25600/0x3a6cb1946bc1840b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18404 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.259210:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25600, rc 0) 00000100:00100000:2.0:1789498467.259337:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885593216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1249us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.259343:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789498467.263154:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498467.263185:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498467.263199:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498467.263291:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498467.263346:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498467.263390:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.265135:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885593344 00000100:00100000:2.0:1789498467.265149:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885593344 00000100:00100000:2.0:1789498467.265217:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789498467.265226:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885593344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.265552:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885593344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.265562:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789498467.265738:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498467.265795:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498467.265846:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498467.265877:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885593472 00000100:00100000:0.0:1789498467.265883:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885593472 00000100:00100000:3.0:1789498467.265889:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498467.265914:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789498467.265922:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885593472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498467.266124:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885593472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498467.266131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789498467.266760:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498467.267446:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11691:1876424885593600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498467.267520:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498467.267554:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498467.267729:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885593600 00000100:00100000:3.0:1789498467.267737:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885593600 00000100:00100000:3.0:1789498467.267781:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789498467.267788:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:11691:x1876424885593600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498467.267995:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:11691:x1876424885593600:12345-0@lo:502:llog_process_th.0 Request processed in 206us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498467.268002:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789498467.268220:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11691:1876424885593600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789498467.268245:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498467.268255:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498467.268257:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789498467.268262:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98ea891b9000 00000020:00000080:0.0:1789498467.268338:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789498467.268414:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11691:1876424885593728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498467.268450:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498467.268547:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885593728 00000100:00100000:1.0:1789498467.268553:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885593728 00000100:00100000:1.0:1789498467.274646:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789498467.274676:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:11691:x1876424885593728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498467.274960:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:11691:x1876424885593728:12345-0@lo:502:llog_process_th.0 Request processed in 301us (6507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498467.275160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789498467.281839:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498467.281899:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11691:1876424885593728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789498467.281950:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498467.284771:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498467.284780:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789498467.284792:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789498467.296023:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789498467.296079:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498467.296122:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498467.296137:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498467.296169:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498467.296172:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eabd51c800 from 7 10000000:01000000:3.0:1789498467.296176:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498467.296218:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498467.296227:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498467.296239:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498467.297035:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498467.297170:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498467.297217:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.297313:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885593856 00000100:00100000:2.0:1789498467.297323:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885593856 00000100:00100000:2.0:1789498467.297389:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789498467.297399:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:5842:x1876424885593856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498467.297415:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498467.297434:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad24400/0x3a6cb1946bc18419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18412 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.297465:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad24400/0x3a6cb1946bc18419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18412 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.297495:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad24400/0x3a6cb1946bc18419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18412 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.297504:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24400, rc 0) 00000100:00100000:2.0:1789498467.297546:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885593856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.297553:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789498467.297985:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498467.298006:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498467.298017:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498467.298147:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498467.298185:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498467.298220:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.298423:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885593984 00000100:00100000:2.0:1789498467.298428:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885593984 00000100:00100000:2.0:1789498467.298473:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789498467.298481:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885593984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.298762:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885593984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.298770:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789498467.298924:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885593984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498467.298967:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885594112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498467.299011:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498467.299035:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad886c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.300182:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885594112 00000100:00100000:2.0:1789498467.300193:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885594112 00000100:00100000:2.0:1789498467.300250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789498467.300258:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885594112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.300471:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885594112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.300479:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789498467.300530:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885594112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.300730:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11694:1876424885594240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498467.300770:0:11694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498467.300811:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885594240 00000100:00100000:2.0:1789498467.300815:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885594240 00000100:00100000:2.0:1789498467.300832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789498467.300838:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:11694:x1876424885594240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498467.300974:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:11694:x1876424885594240:12345-0@lo:502:llog_process_th.0 Request processed in 124us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.300981:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789498467.301019:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.301031:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11694:1876424885594240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498467.301061:0:11694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498467.301072:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498467.301074:0:11694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789498467.301080:0:11694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98eabd51c800 00000020:00000080:2.0:1789498467.301082:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789498467.301181:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11694:1876424885594368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498467.301212:0:11694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498467.301231:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885594368 00000100:00100000:2.0:1789498467.301235:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885594368 00000100:00100000:2.0:1789498467.301251:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789498467.301257:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:11694:x1876424885594368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498467.301357:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:11694:x1876424885594368:12345-0@lo:502:llog_process_th.0 Request processed in 100us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.301364:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789498467.301392:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea885a6780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.301403:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11694:1876424885594368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498467.301419:0:11694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498467.301427:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498467.301429:0:11694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789498467.301433:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789498467.301482:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789498467.301499:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498467.301509:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.301521:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498467.301531:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789498467.301534:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea90a2f000 from 7 10000000:01000000:2.0:1789498467.301537:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789498467.301558:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.301566:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.301575:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498467.301587:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885594496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.301612:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498467.301624:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.301635:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885594496 00000100:00100000:2.0:1789498467.301638:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885594496 00000100:00100000:2.0:1789498467.301654:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789498467.301670:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:5842:x1876424885594496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498467.301679:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498467.301697:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad25000/0x3a6cb1946bc18427 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc18420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.301720:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad25000/0x3a6cb1946bc18427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc18420 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.301730:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad25000/0x3a6cb1946bc18427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc18420 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.301738:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25000, rc 0) 00000100:00100000:2.0:1789498467.301766:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885594496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.301772:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789498467.301803:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885594496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498467.301816:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.301825:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498467.301861:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885594624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.301883:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498467.301895:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea885a6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.301905:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885594624 00000100:00100000:2.0:1789498467.301908:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885594624 00000100:00100000:2.0:1789498467.301925:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789498467.301931:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885594624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.302176:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885594624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.302188:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789498467.302216:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885594624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.302243:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885594752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.302333:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498467.302351:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea885a6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.302361:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885594752 00000100:00100000:2.0:1789498467.302365:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885594752 00000100:00100000:2.0:1789498467.302381:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789498467.302386:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885594752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498467.302495:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:5842:x1876424885594752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.302502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789498467.302533:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec95aa81-4721-4a06-ac30-039c6a8f6732:5842:1876424885594752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498467.310136:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba133800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11695:1876424885594880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498467.310229:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498467.310283:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabaaa73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498467.310801:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885594880 00000100:00100000:2.0:1789498467.310810:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885594880 00000100:00100000:2.0:1789498467.310870:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789498467.310881:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:11695:x1876424885594880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498467.311178:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:11695:x1876424885594880:12345-0@lo:502:llog_process_th.0 Request processed in 298us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498467.311187:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789498467.311202:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba133800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11695:1876424885594880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789498467.311238:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498467.311248:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498467.311250:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789498467.311257:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98ea90a2f000 00000020:00000080:0.0:1789498467.311259:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789498467.311351:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11695:1876424885595008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498467.311391:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498467.311428:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498467.311738:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885595008 00000100:00100000:1.0:1789498467.311744:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885595008 00000100:00100000:1.0:1789498467.311780:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789498467.311787:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:11695:x1876424885595008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498467.311945:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:11695:x1876424885595008:12345-0@lo:502:llog_process_th.0 Request processed in 158us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498467.311959:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789498467.312749:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec95aa81-4721-4a06-ac30-039c6a8f6732:11695:1876424885595008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789498467.312781:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498467.312787:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498467.312800:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789498467.312804:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:3.0:1789498467.314185:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:2.0:1789498467.314594:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789498467.314619:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498467.314632:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498467.314658:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498467.819480:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885595264:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.819550:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498467.819630:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789498467.819637:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885595136:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.819670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498467.819690:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885595648:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.819727:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498467.819763:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885595520:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.819786:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498467.819801:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498467.819806:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885595392:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.819826:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498467.819854:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885595264 00000100:00100000:3.0:1789498467.819862:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885595264 00000100:00100000:3.0:1789498467.819918:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885595136 00000100:00100000:3.0:1789498467.819921:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885595136 00000100:00100000:3.0:1789498467.819933:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885595520 00000100:00100000:3.0:1789498467.819935:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885595520 00000100:00100000:3.0:1789498467.819951:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789498467.819959:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885595264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820014:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885595264:12345-0@lo:400:kworker.0 Request processed in 56us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498467.820022:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789498467.820040:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789498467.820047:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885595136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820120:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885595136:12345-0@lo:400:kworker.0 Request processed in 73us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498467.820126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789498467.820138:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789498467.820144:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885595520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820176:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885595520:12345-0@lo:400:kworker.0 Request processed in 33us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498467.820182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789498467.820200:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885595648 00000100:00100000:3.0:1789498467.820204:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885595648 00000100:00100000:3.0:1789498467.820228:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885595392 00000100:00100000:3.0:1789498467.820231:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885595392 00000100:00100000:3.0:1789498467.820247:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498467.820254:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885595648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820283:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885595648:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498467.820289:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498467.820300:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789498467.820305:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885595392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820330:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885595392:12345-0@lo:400:kworker.0 Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498467.820336:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789498467.820375:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba135500 x1876424885595392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498467.820388:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885595392:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820398:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885595520:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820434:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885595136:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820443:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885595648:0@lo:400:kworker.0 00000100:00100000:3.0:1789498467.820452:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885595264:0@lo:400:kworker.0 00000100:00080000:0.0:1789498467.820907:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498467.820912:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498467.820915:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498468.267877:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498468.331373:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885595776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498468.331470:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498468.331558:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885595776 00000100:00100000:1.0:1789498468.331566:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885595776 00000100:00100000:1.0:1789498468.331615:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789498468.331628:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885595776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498468.331795:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498468.331859:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885595776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 235us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498468.332248:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789498468.332303:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885595776:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789498468.332453:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789498468.332524:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498468.332537:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885595904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498468.332579:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498468.332631:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885595904 00000100:00100000:0.0:1789498468.332636:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885595904 00000100:00100000:0.0:1789498468.332676:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789498468.332684:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885595904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498468.335325:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498468.335412:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885595904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2725us (2828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498468.335435:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789498468.335494:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba8f4700 x1876424885595904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498468.335518:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885595904:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789498468.435106:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1789498469.291489:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498470.315258:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498471.339426:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498471.823491:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498471.823531:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498471.823595:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498471.823634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498471.823642:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864587776 00000100:00100000:0.0:1789498471.823654:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864587776 00000100:00100000:2.0:1789498471.823661:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864587904 00000100:00100000:2.0:1789498471.823664:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864587904 00000100:00100000:1.0:1789498471.823771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864587648 00000100:00100000:1.0:1789498471.823776:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864587648 00000100:00100000:1.0:1789498471.823809:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 280 00000100:00100000:1.0:1789498471.823820:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864587648:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498471.823921:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864587648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498471.823929:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 280 00000100:00100000:0.0:1789498471.823982:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864588032 00000100:00100000:0.0:1789498471.823986:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864588032 00000100:00100000:2.0:1789498471.825060:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:2.0:1789498471.825073:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864587904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498471.825157:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864587904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 88us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498471.825165:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00080000:2.0:1789498471.825337:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498471.825345:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498471.828637:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:3.0:1789498471.828663:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864587776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498471.828766:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864587776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 116us (5284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498471.828774:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:0.0:1789498471.829658:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:0.0:1789498471.829669:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864588032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498471.829718:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864588032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 50us (6185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498471.829725:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 121 00010000:00010000:3.0:1789498472.363355:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498472.939730:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885596160:0@lo:400:kworker.0 00000100:00100000:3.0:1789498472.939804:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498472.939870:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885596672:0@lo:400:kworker.0 00000100:00100000:3.0:1789498472.939895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498472.939923:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498472.939929:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885596288:0@lo:400:kworker.0 00000100:00100000:3.0:1789498472.939950:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498472.940025:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885596032:0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.940072:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498472.940123:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885596544:0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.940157:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498472.940176:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498472.940182:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885596416:0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.940203:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498472.940363:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885596672 00000100:00100000:1.0:1789498472.940372:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885596672 00000100:00100000:1.0:1789498472.940425:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885596416 00000100:00100000:1.0:1789498472.940429:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885596416 00000100:00100000:1.0:1789498472.940452:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498472.940461:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885596672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.940510:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885596672:12345-0@lo:400:kworker.0 Request processed in 51us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498472.940518:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498472.940534:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498472.940539:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885596416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.940583:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885596416:12345-0@lo:400:kworker.0 Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498472.940590:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789498472.940632:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cfa680 x1876424885596416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498472.940666:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885596416:0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.940694:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789498472.940700:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eaba8f7b80, transno 4294967300 00000100:00100000:1.0:1789498472.940710:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885596672:0@lo:400:kworker.0 00000100:00100000:0.0:1789498472.940857:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885596160 00000100:00100000:0.0:1789498472.940862:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885596160 00000100:00100000:0.0:1789498472.940897:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885596288 00000100:00100000:0.0:1789498472.940900:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885596288 00000100:00100000:0.0:1789498472.940912:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885596544 00000100:00100000:0.0:1789498472.940915:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885596544 00000100:00100000:0.0:1789498472.940927:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789498472.940933:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885596160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498472.940970:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885596160:12345-0@lo:400:kworker.0 Request processed in 37us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498472.940975:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789498472.940987:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789498472.940992:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885596288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498472.941017:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885596288:12345-0@lo:400:kworker.0 Request processed in 25us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498472.941022:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789498472.941032:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789498472.941038:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885596544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498472.941076:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885596544:12345-0@lo:400:kworker.0 Request processed in 39us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498472.941117:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789498472.941303:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885596032 00000100:00100000:3.0:1789498472.941308:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885596032 00000100:00100000:3.0:1789498472.941345:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789498472.941351:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885596032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498472.941383:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885596032:12345-0@lo:400:kworker.0 Request processed in 32us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498472.941395:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:3.0:1789498472.941422:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498472.941428:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498472.941431:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498472.941817:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885596032:0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.941831:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885596544:0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.941859:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885596288:0@lo:400:kworker.0 00000100:00100000:1.0:1789498472.941871:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885596160:0@lo:400:kworker.0 00010000:00010000:1.0:1789498473.389613:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498473.451394:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885596800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498473.451470:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498473.451562:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885596800 00000100:00100000:2.0:1789498473.451572:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885596800 00000100:00100000:2.0:1789498473.451619:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498473.451628:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885596800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498473.451665:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498473.451720:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885596800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498473.451728:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789498473.451788:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba8f7b80 x1876424885596800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498473.451809:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885596800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498473.451984:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885596928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498473.452037:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498473.452182:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885596928 00000100:00100000:0.0:1789498473.452188:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885596928 00000100:00100000:0.0:1789498473.452222:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789498473.452232:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885596928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498473.452253:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498473.452291:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885596928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498473.452302:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789498473.452333:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885596928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789498474.411258:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498475.435411:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498476.459303:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498476.942612:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498476.942662:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498476.942702:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498476.942737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498476.942811:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864588288 00000100:00100000:0.0:1789498476.942830:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864588288 00000100:00100000:1.0:1789498476.942849:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864588160 00000100:00100000:1.0:1789498476.942861:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864588160 00000100:00100000:0.0:1789498476.942938:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864588544 00000100:00100000:0.0:1789498476.942944:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864588544 00000100:00100000:1.0:1789498476.942950:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 282 00000100:00100000:1.0:1789498476.942966:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864588160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498476.943008:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:0.0:1789498476.943024:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864588288:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498476.943065:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864588160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498476.943141:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 282 00000100:00100000:0.0:1789498476.943174:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864588288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 153us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498476.943184:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:0.0:1789498476.943213:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:0.0:1789498476.943222:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864588544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498476.943260:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864588544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498476.943267:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00080000:2.0:1789498476.943296:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498476.943512:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864588416 00000100:00100000:3.0:1789498476.943520:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864588416 00000100:00100000:3.0:1789498476.943593:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1789498476.943603:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864588416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:2.0:1789498476.943675:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498476.948041:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864588416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 4420us (5357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498476.948062:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00010000:00010000:1.0:1789498477.483396:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498478.061375:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885597056:0@lo:400:kworker.0 00000100:00100000:1.0:1789498478.061464:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885597184:0@lo:400:kworker.0 00000100:00100000:2.0:1789498478.061490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498478.061559:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498478.061603:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885597696:0@lo:400:kworker.0 00000100:00100000:2.0:1789498478.061611:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885597568:0@lo:400:kworker.0 00000100:00100000:1.0:1789498478.061648:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498478.061664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498478.061689:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498478.061701:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498478.061703:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885597312:0@lo:400:kworker.0 00000100:00100000:2.0:1789498478.061715:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885597440:0@lo:400:kworker.0 00000100:00100000:1.0:1789498478.061750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498478.061771:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498478.061822:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885597696 00000100:00100000:2.0:1789498478.061833:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885597056 00000100:00100000:1.0:1789498478.061836:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885597696 00000100:00100000:2.0:1789498478.061844:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885597056 00000100:00100000:2.0:1789498478.061905:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789498478.061918:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885597056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498478.061918:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885597440 00000100:00100000:1.0:1789498478.061925:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885597440 00000100:00100000:1.0:1789498478.061983:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789498478.061995:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83736d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885597696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498478.062004:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885597056:12345-0@lo:400:kworker.0 Request processed in 89us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498478.062013:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789498478.062075:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83736d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885597696:12345-0@lo:400:kworker.0 Request processed in 81us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498478.062080:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789498478.062140:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789498478.062171:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885597440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498478.062211:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885597696:0@lo:400:kworker.0 00000100:00100000:2.0:1789498478.062221:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885597440:12345-0@lo:400:kworker.0 Request processed in 54us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498478.062230:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789498478.062268:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498478.062277:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789498478.062292:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ea8535dc00 x1876424885597440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498478.062307:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885597440:0@lo:400:kworker.0 00000100:00100000:2.0:1789498478.062316:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885597056:0@lo:400:kworker.0 00000100:00100000:0.0:1789498478.062518:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885597184 00000100:00100000:0.0:1789498478.062525:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885597184 00000100:00100000:0.0:1789498478.062570:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885597568 00000100:00100000:0.0:1789498478.062573:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885597568 00000100:00100000:0.0:1789498478.062600:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885597312 00000100:00100000:0.0:1789498478.062603:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885597312 00000100:00100000:0.0:1789498478.062619:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789498478.062626:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885597184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498478.062688:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885597184:12345-0@lo:400:kworker.0 Request processed in 63us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498478.062707:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789498478.062723:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789498478.062730:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885597568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498478.062765:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885597568:12345-0@lo:400:kworker.0 Request processed in 36us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498478.062771:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789498478.062783:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789498478.062788:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885597312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498478.062816:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885597312:12345-0@lo:400:kworker.0 Request processed in 28us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498478.062822:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789498478.062909:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885597312:0@lo:400:kworker.0 00000100:00100000:3.0:1789498478.062922:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885597184:0@lo:400:kworker.0 00000100:00080000:2.0:1789498478.063042:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498478.063079:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885597568:0@lo:400:kworker.0 00010000:00010000:3.0:1789498478.507249:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498478.571635:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885597824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498478.571742:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498478.571862:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885597824 00000100:00100000:1.0:1789498478.571872:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885597824 00000100:00100000:1.0:1789498478.571929:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789498478.571972:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83737100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885597824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498478.572026:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498478.572081:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83737100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885597824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498478.572111:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789498478.572325:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885597824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498478.572713:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498478.572728:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885597952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498478.572766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498478.572799:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885597952 00000100:00100000:2.0:1789498478.572803:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885597952 00000100:00100000:2.0:1789498478.572830:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789498478.572838:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885597952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498478.572865:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498478.572900:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885597952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498478.572907:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1789498478.572935:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba8f5500 x1876424885597952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498478.572951:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885597952:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498478.575338:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789498479.532485:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498480.555251:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498481.579754:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498482.065315:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498482.065356:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498482.065406:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864588800 00000100:00100000:0.0:1789498482.065417:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864588800 00000100:00100000:0.0:1789498482.065484:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00080000:2.0:1789498482.065528:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498482.065533:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864588672 00000100:00100000:1.0:1789498482.065538:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864588672 00000100:00100000:1.0:1789498482.065580:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 284 00000100:00100000:1.0:1789498482.065589:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864588672:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498482.065676:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864588672:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 89us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498482.065683:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 284 00000100:00100000:0.0:1789498482.065933:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864588800:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498482.065980:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864588800:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 487us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498482.068559:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:0.0:1789498482.077519:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498482.077622:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864588928 00000100:00100000:1.0:1789498482.077633:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864588928 00000100:00100000:1.0:1789498482.077713:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:1.0:1789498482.077723:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2354:x1876424864588928:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:1.0:1789498482.077755:0:10445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18363 00000100:00080000:1.0:1789498482.077764:0:10445:0:(import.c:65:import_set_state_nolock()) ffff98ea857a2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498482.077806:0:10445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789498482.077940:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498482.078034:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498482.078056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864589056 00000100:00100000:3.0:1789498482.078060:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864589056 00000100:00100000:1.0:1789498482.078118:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+2:2354:x1876424864588928:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 395us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498482.078120:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:1.0:1789498482.078126:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1789498482.078127:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864589056:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498482.078156:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864589056:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498482.078179:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00080000:2.0:1789498482.078292:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498482.078298:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789498482.603663:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498483.179543:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885598336:0@lo:400:kworker.0 00000100:00100000:3.0:1789498483.179621:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498483.179696:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789498483.179703:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885598208:0@lo:400:kworker.0 00000100:00100000:3.0:1789498483.179727:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498483.179745:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885598720:0@lo:400:kworker.0 00000100:00100000:3.0:1789498483.179782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498483.179821:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885598336 00000100:00100000:3.0:1789498483.179828:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885598336 00000100:00100000:3.0:1789498483.179886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885598208 00000100:00100000:3.0:1789498483.179889:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885598208 00000100:00100000:3.0:1789498483.179912:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789498483.179920:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885598336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498483.179984:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885598336:12345-0@lo:400:kworker.0 Request processed in 64us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498483.179992:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789498483.180009:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789498483.180016:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885598208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498483.180041:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885598208:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498483.180046:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789498483.180064:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885598720 00000100:00100000:3.0:1789498483.180067:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885598720 00000100:00100000:3.0:1789498483.180121:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789498483.180129:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885598720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498483.180180:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885598720:12345-0@lo:400:kworker.0 Request processed in 52us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498483.180186:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789498483.180227:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885598208:0@lo:400:kworker.0 00000100:00100000:3.0:1789498483.180238:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885598720:0@lo:400:kworker.0 00000100:00100000:3.0:1789498483.180246:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885598336:0@lo:400:kworker.0 00000100:00100000:2.0:1789498483.180629:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885598080:0@lo:400:kworker.0 00000100:00100000:2.0:1789498483.180669:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498483.180712:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885598592:0@lo:400:kworker.0 00000100:00100000:2.0:1789498483.180733:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498483.180762:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498483.180767:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885598464:0@lo:400:kworker.0 00000100:00100000:2.0:1789498483.180786:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789498483.180809:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498483.180813:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498483.180823:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885598464 00000100:00100000:2.0:1789498483.180827:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885598464 00000100:00100000:2.0:1789498483.180854:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789498483.180870:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885598464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498483.180905:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885598464:12345-0@lo:400:kworker.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498483.180911:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789498483.180924:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789498483.180940:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba130a80 x1876424885598464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498483.181024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885598080 00000100:00100000:0.0:1789498483.181028:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885598080 00000100:00100000:0.0:1789498483.181053:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789498483.181059:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885598080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498483.181138:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885598080:12345-0@lo:400:kworker.0 Request processed in 78us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498483.181144:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789498483.181395:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885598592 00000100:00100000:1.0:1789498483.181399:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885598592 00000100:00100000:1.0:1789498483.181446:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789498483.181453:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885598592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498483.181490:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885598592:12345-0@lo:400:kworker.0 Request processed in 37us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498483.181495:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1789498483.181562:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498483.181615:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885598464:0@lo:400:kworker.0 00000100:00100000:2.0:1789498483.181628:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885598080:0@lo:400:kworker.0 00000100:00100000:2.0:1789498483.181637:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885598592:0@lo:400:kworker.0 00010000:00010000:3.0:1789498483.627207:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498483.691462:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498483.691487:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885598848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498483.691578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498483.691650:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885598848 00000100:00100000:0.0:1789498483.691659:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885598848 00000100:00100000:0.0:1789498483.691705:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789498483.691715:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885598848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498483.691767:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498483.691813:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885598848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498483.691820:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789498483.691879:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885598848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498483.695952:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885598976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498483.696031:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498483.696129:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885598976 00000100:00100000:2.0:1789498483.696136:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885598976 00000100:00100000:2.0:1789498483.696180:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498483.696188:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885598976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498483.696232:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498483.696277:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885598976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498483.696284:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789498483.696331:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e986cfa680 x1876424885598976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498483.696351:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885598976:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789498483.771827:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:1.0:1789498483.771836:0:7653:0:(genops.c:885:class_export_put()) final put ffff98eababdb000/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:0.0:1789498483.772028:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eababdb000/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c for lustre-OST0001 00000020:00000080:0.0:1789498483.772087:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea857a2800 for lustre-OST0001 00010000:00010000:1.0:1789498484.651376:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498485.675206:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498486.699907:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498487.182526:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498487.182703:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498487.182737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498487.182776:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864589440 00000100:00100000:0.0:1789498487.182789:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864589440 00000100:00100000:0.0:1789498487.182861:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864589312 00000100:00100000:0.0:1789498487.182865:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864589312 00000100:00100000:0.0:1789498487.182891:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:0.0:1789498487.182902:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864589440:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498487.183009:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864589440:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 107us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498487.183018:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:0.0:1789498487.183039:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:0.0:1789498487.183046:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864589312:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498487.183072:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864589312:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498487.183078:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:3.0:1789498487.183681:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864589184 00000100:00100000:3.0:1789498487.183688:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864589184 00000100:00100000:3.0:1789498487.183731:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 286 00000100:00100000:3.0:1789498487.183739:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864589184:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498487.183775:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864589184:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498487.183781:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 286 00000100:00080000:0.0:1789498487.185028:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498487.723374:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498488.304511:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498488.304545:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885599104:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.304659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498488.304745:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885599104 00000100:00100000:2.0:1789498488.304757:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885599104 00000100:00100000:2.0:1789498488.304830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789498488.304842:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885599104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.304914:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885599104:12345-0@lo:400:kworker.0 Request processed in 74us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498488.304924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789498488.304989:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885599104:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305049:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885599232:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305082:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498488.305165:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885599360:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305194:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498488.305231:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885599232 00000100:00100000:2.0:1789498488.305236:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885599232 00000100:00100000:2.0:1789498488.305301:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885599360 00000100:00100000:2.0:1789498488.305306:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885599360 00000100:00100000:2.0:1789498488.305347:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789498488.305354:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885599232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305399:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885599232:12345-0@lo:400:kworker.0 Request processed in 45us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498488.305407:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789498488.305421:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789498488.305428:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885599360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305484:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885599360:12345-0@lo:400:kworker.0 Request processed in 56us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498488.305491:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1789498488.305515:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498488.305545:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885599232:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885599360:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305602:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885599488:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305636:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498488.305682:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498488.305689:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885599616:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305715:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498488.305737:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885599616 00000100:00100000:2.0:1789498488.305741:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885599616 00000100:00100000:2.0:1789498488.305769:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789498488.305776:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885599616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305810:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885599616:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498488.305826:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1789498488.305842:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498488.305859:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885599616:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305895:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885599744:0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.305922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498488.305953:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885599488 00000100:00100000:2.0:1789498488.305957:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885599488 00000100:00100000:2.0:1789498488.305991:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885599744 00000100:00100000:2.0:1789498488.305994:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885599744 00000100:00100000:2.0:1789498488.306018:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789498488.306025:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885599488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.306064:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885599488:12345-0@lo:400:kworker.0 Request processed in 39us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498488.306071:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789498488.306083:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789498488.306118:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885599744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498488.306154:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885599744:12345-0@lo:400:kworker.0 Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498488.306161:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789498488.306184:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498488.306187:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498488.306204:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885599744:0@lo:400:kworker.0 00010000:00080000:2.0:1789498488.306230:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba135500 x1876424885599488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498488.306243:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885599488:0@lo:400:kworker.0 00010000:00010000:2.0:1789498488.765490:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498488.813658:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885599872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498488.813767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498488.814081:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885599872 00000100:00100000:3.0:1789498488.814111:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885599872 00000100:00100000:3.0:1789498488.814163:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789498488.814172:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885599872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498488.814217:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498488.814268:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885599872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498488.814291:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789498488.814564:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498488.814589:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885600000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498488.814622:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789498488.814630:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789498488.814701:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885600000 00000100:00100000:2.0:1789498488.814706:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885600000 00000100:00100000:2.0:1789498488.814732:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789498488.814739:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885600000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498488.814764:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498488.814803:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885600000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498488.814809:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789498488.814845:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba8f7b80 x1876424885600000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498488.814866:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885600000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498488.814884:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885599872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789498489.771473:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789498490.645491:0:11860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:54:48 (1789498488) 00010000:00010000:2.0:1789498490.796502:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498491.819285:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498492.304817:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498492.304898:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498492.304933:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498492.305028:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864589824 00000100:00100000:2.0:1789498492.305038:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864589824 00000100:00100000:2.0:1789498492.305140:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864589696 00000100:00100000:2.0:1789498492.305144:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864589696 00000100:00100000:2.0:1789498492.305168:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:2.0:1789498492.305178:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864589824:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498492.305225:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 141 00000100:00100000:0.0:1789498492.305237:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864589696:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498492.305278:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864589824:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 100us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498492.305290:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:0.0:1789498492.305298:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864589696:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 44us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498492.305308:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 141 00000100:00080000:1.0:1789498492.305559:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498492.305913:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864589568 00000100:00100000:3.0:1789498492.305918:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864589568 00000100:00100000:3.0:1789498492.305952:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 288 00000100:00100000:3.0:1789498492.305959:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864589568:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498492.306337:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864589568:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 377us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498492.306345:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 288 00000100:00100000:1.0:1789498492.547384:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498492.547725:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864589952 00000100:00100000:2.0:1789498492.547749:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864589952 00000100:00100000:2.0:1789498492.547817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:2.0:1789498492.547915:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:10230:x1876424864589952:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498492.547936:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498492.547958:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1842e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a007 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.548018:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18435 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.548030:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.548044:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498492.548085:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498492.549052:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498492.549123:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.549153:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1842e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a007 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.549176:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18435 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a007 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.549186:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498492.549189:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498492.549193:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24600, rc 0) 00000100:00100000:2.0:1789498492.549299:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:10230:x1876424864589952:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1388us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498492.549307:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:0.0:1789498492.562250:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498492.562349:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864590080 00000100:00100000:2.0:1789498492.562361:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864590080 00000100:00100000:2.0:1789498492.562424:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:2.0:1789498492.562435:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:10231:x1876424864590080:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498492.562458:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498492.562491:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1843c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a00e expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.562573:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.562589:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.562802:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.562834:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.562843:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.562851:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563076:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25a00/0x3a6cb1946bc18451 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563124:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25a00/0x3a6cb1946bc18451 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563133:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25a00/0x3a6cb1946bc18451 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498492.563166:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498492.563169:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498492.563189:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25a00/0x3a6cb1946bc18451 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563200:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563216:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563224:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563230:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498492.563234:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563242:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563253:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498492.563256:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498492.563261:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563277:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563289:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563296:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563302:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563307:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498492.563310:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563317:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563325:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98eaa1d46800) 00010000:00010000:2.0:1789498492.563328:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498492.563330:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563337:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1844a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563367:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1843c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a00e expref: 8 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563380:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25a00/0x3a6cb1946bc18451 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a00e expref: 7 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.563394:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98eaa1d46700) 00010000:00010000:2.0:1789498492.563396:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498492.563398:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25a00, rc 0) 00000100:00100000:2.0:1789498492.563465:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:10231:x1876424864590080:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1032us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498492.563472:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1789498492.571853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498492.571950:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864590336 00000100:00100000:2.0:1789498492.571961:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864590336 00000100:00100000:2.0:1789498492.572021:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:2.0:1789498492.572031:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:10231:x1876424864590336:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498492.572054:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498492.572074:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18458 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a015 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572171:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572186:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572197:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572300:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572308:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572330:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572719:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24a00/0x3a6cb1946bc1846d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572728:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24a00/0x3a6cb1946bc1846d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572736:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24a00/0x3a6cb1946bc1846d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498492.572746:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789498492.572916:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572925:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572932:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572939:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498492.572943:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572951:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572963:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98eaa1d46700) 00010000:00010000:2.0:1789498492.572967:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498492.572978:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.572986:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1845f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573000:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573007:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573013:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573018:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498492.573021:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573027:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573035:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98eaa1d46800) 00010000:00010000:2.0:1789498492.573038:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498492.573041:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573047:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18466 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573576:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18458 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a015 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573605:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24a00/0x3a6cb1946bc1846d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a015 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498492.573613:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:2.0:1789498492.573616:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498492.573618:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24a00, rc 0) 00000100:00100000:2.0:1789498492.573693:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:10231:x1876424864590336:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1663us (1850us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789498492.573701:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:1.0:1789498492.580551:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498492.582589:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864590464 00000100:00100000:2.0:1789498492.582616:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864590464 00000100:00100000:2.0:1789498492.582688:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:2.0:1789498492.582699:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:10231:x1876424864590464:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789498492.582814:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:10231:x1876424864590464:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 Request processed in 116us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498492.582834:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00010000:00010000:0.0:1789498492.843280:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498492.908143:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789498493.419315:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885600128:0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.419396:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498493.419444:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885600640:0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.419473:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498493.419499:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498493.419505:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885600512:0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.419531:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498493.419556:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885600256:0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.419588:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498493.419613:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885600768:0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.419632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498493.419649:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498493.419654:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885600384:0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.419673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498493.419700:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885600640 00000100:00100000:2.0:1789498493.419707:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885600640 00000100:00100000:3.0:1789498493.419867:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885600128 00000100:00100000:3.0:1789498493.419871:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885600128 00000100:00100000:3.0:1789498493.419916:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789498493.419925:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885600128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498493.419976:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885600128:12345-0@lo:400:kworker.0 Request processed in 52us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498493.419983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789498493.420033:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885600128:0@lo:400:kworker.0 00000100:00100000:3.0:1789498493.420070:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885600512 00000100:00100000:3.0:1789498493.421099:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885600512 00000100:00100000:0.0:1789498493.422131:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885600256 00000100:00100000:0.0:1789498493.422139:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885600256 00000100:00100000:0.0:1789498493.422187:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885600384 00000100:00100000:0.0:1789498493.422198:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885600384 00000100:00100000:2.0:1789498493.428793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789498493.428811:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885600256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.428922:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885600256:12345-0@lo:400:kworker.0 Request processed in 117us (9332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498493.428929:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789498493.428946:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789498493.428965:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885600640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.429002:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885600640:12345-0@lo:400:kworker.0 Request processed in 51us (9529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498493.429008:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789498493.429164:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885600256:0@lo:400:kworker.0 00000100:00100000:2.0:1789498493.431494:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885600768 00000100:00100000:2.0:1789498493.431510:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885600768 00000100:00100000:3.0:1789498493.431629:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789498493.431641:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885600512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498493.431733:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885600512:12345-0@lo:400:kworker.0 Request processed in 95us (12200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498493.431752:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789498493.431802:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fa4e00 x1876424885600512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789498509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498493.431818:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885600512:0@lo:400:kworker.0 00000100:00100000:3.0:1789498493.431832:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885600640:0@lo:400:kworker.0 00000100:00100000:0.0:1789498493.433605:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789498493.433618:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885600384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498493.433702:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885600384:12345-0@lo:400:kworker.0 Request processed in 87us (14027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498493.433723:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789498493.433774:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885600384:0@lo:400:kworker.0 00000100:00080000:1.0:1789498493.445047:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498493.445058:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498493.445061:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498493.455008:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789498493.455023:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885600768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498493.455144:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885600768:12345-0@lo:400:kworker.0 Request processed in 125us (35510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498493.455151:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789498493.455209:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885600768:0@lo:400:kworker.0 00010000:00010000:3.0:1789498493.868353:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498493.932406:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885600896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498493.932603:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498493.934322:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885600896 00000100:00100000:0.0:1789498493.934336:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885600896 00000100:00100000:0.0:1789498493.934399:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789498493.934410:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885600896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498493.934461:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498493.934538:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885600896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498493.934546:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789498493.935423:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498493.935451:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885601024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498493.935500:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498493.936138:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885601024 00000100:00100000:2.0:1789498493.936147:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885601024 00000100:00100000:2.0:1789498493.936321:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789498493.936331:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885601024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498493.936368:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498493.936449:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885601024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498493.936457:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1789498493.936496:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabae8ce00 x1876424885601024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498493.936515:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885601024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498493.936764:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885600896:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789498493.973599:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:1.0:1789498494.819435:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498494.819503:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864590592 00000100:00100000:2.0:1789498494.819513:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864590592 00000100:00100000:2.0:1789498494.819591:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:2.0:1789498494.819602:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:10274:x1876424864590592:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498494.819623:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498494.819645:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1847b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a01c expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.819707:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.819721:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.819733:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.819745:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.819751:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.819757:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820236:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820246:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820253:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820259:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498494.820263:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820270:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820283:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498494.820286:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498494.820291:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820296:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820309:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820315:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820321:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820333:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498494.820336:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820342:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820350:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98eaa1d46800) 00010000:00010000:2.0:1789498494.820352:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498494.820354:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820359:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18489 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820393:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1847b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a01c expref: 9 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820403:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498494.820405:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498494.820408:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1847b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a01c expref: 9 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.820416:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25c00, rc 0) 00000100:00100000:2.0:1789498494.820477:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:10274:x1876424864590592:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 875us (1063us total) trans 0 rc 301/301 00000100:00100000:2.0:1789498494.820485:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00080000:1.0:1789498494.820682:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498494.849924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498494.849993:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864590848 00000100:00100000:0.0:1789498494.850003:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864590848 00000100:00100000:0.0:1789498494.850058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:0.0:1789498494.850069:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:10274:x1876424864590848:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:0.0:1789498494.850197:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498494.850227:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18435 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a007 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.850244:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:0.0:1789498494.850256:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498494.850498:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.850523:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.850534:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.850548:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.850555:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.850561:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498494.851525:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789498494.851540:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.851549:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.851557:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.851563:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498494.851568:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.851575:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.851598:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498494.851601:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498494.851606:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.851613:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18490 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498494.851629:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006212070d reply state 0000000068f9445a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498494.851638:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498494.851748:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:10274:x1876424864590848:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 1679us (1828us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789498494.851756:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00010000:00010000:0.0:1789498494.860833:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.860852:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.860860:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.860867:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498494.860871:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.860879:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.860907:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498494.860911:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498494.860916:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498494.860923:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18497 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498494.907576:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498494.982635:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498494.982890:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864590976 00000100:00100000:2.0:1789498494.982914:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864590976 00000100:00100000:2.0:1789498494.982974:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:2.0:1789498494.982985:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:10282:x1876424864590976:12345-192.168.201.20@tcp:101:lctl.0 00010000:00010000:2.0:1789498494.983010:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498494.983033:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1849e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a023 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.983212:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc184a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.983227:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.983239:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498494.983281:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498494.983285:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498494.983322:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.983346:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1849e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a023 expref: 10 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.983364:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc184a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a023 expref: 9 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498494.983372:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:2.0:1789498494.983375:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498494.983378:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25400, rc 0) 00000100:00100000:2.0:1789498494.983852:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:10282:x1876424864590976:12345-192.168.201.20@tcp:101:lctl.0 Request processed in 867us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498494.983861:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:1.0:1789498495.102866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498495.103021:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864591104 00000100:00100000:0.0:1789498495.103031:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864591104 00000100:00100000:0.0:1789498495.103129:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:0.0:1789498495.103139:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:10288:x1876424864591104:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498495.103158:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498495.103456:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc184ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a02a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103577:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103590:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103601:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103615:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103622:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103640:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103878:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc184c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103885:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc184c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.103892:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc184c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498495.103982:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789498495.103985:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498495.104020:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc184c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104030:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104037:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104044:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104050:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498495.104054:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104061:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104077:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:0.0:1789498495.104080:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498495.104086:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104544:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc184b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104560:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104566:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104573:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104578:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498495.104581:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104587:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104595:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498495.104597:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498495.104600:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.104606:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc184ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.105138:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc184ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a02a expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.105157:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc184c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a02a expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.105174:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498495.105176:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789498495.105179:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5600, rc 0) 00000100:00100000:0.0:1789498495.105269:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:10288:x1876424864591104:12345-192.168.201.20@tcp:101:bash.0 Request processed in 2130us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498495.105277:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498495.109487:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.109733:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864591360 00000100:00100000:2.0:1789498495.109744:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864591360 00000100:00100000:2.0:1789498495.109800:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:2.0:1789498495.109809:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:10288:x1876424864591360:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498495.109833:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498495.109854:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc184c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a031 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.109985:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.110000:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.110012:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.110073:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.110081:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.110086:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789498495.111204:0:7250:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789498495.111600:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111625:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111637:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111742:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111751:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111758:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111764:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498495.111769:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111777:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111789:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498495.111792:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498495.111797:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111803:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc184cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498495.111818:0:7250:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015e3ac13 reply state 000000003d171af7 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498495.111833:0:7250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789498495.111871:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc184c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 13 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111887:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 12 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.111895:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498495.111897:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498495.111900:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24000, rc 0) 00000100:00100000:2.0:1789498495.112032:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:10288:x1876424864591360:12345-192.168.201.20@tcp:101:bash.0 Request processed in 2223us (2555us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789498495.112041:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:3.0:1789498495.125547:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.125631:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864591488 00000100:00100000:2.0:1789498495.125642:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864591488 00000100:00100000:2.0:1789498495.125696:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498495.125704:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1876424864591488:12345-192.168.201.20@tcp:8:bash.0 00010000:00080000:2.0:1789498495.125735:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:2.0:1789498495.125769:0:6704:0:(genops.c:1384:class_connect()) connect: client 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c, cookie 0x3a6cb1946bc184eb 00002000:00100000:2.0:1789498495.125781:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c/ffff98eaba12e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789498495.125792:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789498495.126035:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789498495.126064:0:6704:0:(import.c:65:import_set_state_nolock()) ffff98eaba12b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498495.126171:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2354:x1876424864591488:12345-192.168.201.20@tcp:8:bash.0 Request processed in 456us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498495.126198:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00010000:00010000:1.0:1789498495.126630:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.126658:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.126666:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.126672:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498495.126677:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.126686:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.126702:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98eaa1d46e00) 00010000:00010000:1.0:1789498495.126705:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498495.126710:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.126716:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc184d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498495.129679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.129760:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864591616 00000100:00100000:3.0:1789498495.129771:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864591616 00000100:00100000:3.0:1789498495.129842:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:3.0:1789498495.129852:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:0:x1876424864591616:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498495.129870:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498495.129905:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a038 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498495.129934:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789498495.129954:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1789498495.129958:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498495.129968:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.129986:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.130000:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030a00, rc 0) 00000100:00100000:3.0:1789498495.130066:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:0:x1876424864591616:12345-192.168.201.20@tcp:101:bash.0 Request processed in 216us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498495.130072:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00080000:1.0:1789498495.130307:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498495.136604:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.136702:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864591744 00000100:00100000:2.0:1789498495.136714:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864591744 00000100:00100000:2.0:1789498495.136775:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1789498495.136786:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:10288:x1876424864591744:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498495.136804:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498495.136827:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a03f expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.136881:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.136890:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498495.136896:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498495.136901:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.136935:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.136949:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 8 pid: 6701 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498495.136963:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6704:1876424885601152:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498495.137070:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498495.140021:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6704:1876424885601152:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498495.140056:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.140076:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25800, rc 0) 00000100:00100000:2.0:1789498495.140184:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:10288:x1876424864591744:12345-192.168.201.20@tcp:101:bash.0 Request processed in 3400us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498495.140192:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1789498495.140444:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.140814:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864591872 00000100:00100000:3.0:1789498495.140823:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864591872 00010000:00010000:3.0:1789498495.140860:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 8 pid: 6701 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498495.140899:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:3.0:1789498495.140909:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864591872:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498495.140922:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498495.140947:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 8 pid: 6701 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.140981:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 8 pid: 6701 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.141004:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc184f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a038 expref: 8 pid: 6701 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.141020:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498495.141024:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498495.141032:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.141042:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.141074:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498495.141133:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876424885601280:192.168.201.20@tcp:105: 00000100:00100000:3.0:1789498495.141211:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa055f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498495.146260:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876424885601280:192.168.201.20@tcp:105: 00010000:00010000:3.0:1789498495.146290:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498495.146343:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864591872:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 5434us (5898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498495.146354:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:0.0:1789498495.155772:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.155864:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864592128 00000100:00100000:2.0:1789498495.155875:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864592128 00000100:00100000:2.0:1789498495.155934:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1789498495.155944:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:10288:x1876424864592128:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:2.0:1789498495.156360:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:10288:x1876424864592128:12345-192.168.201.20@tcp:35:bash.0 Request processed in 417us (596us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789498495.156369:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:0.0:1789498495.310807:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.310959:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864592384 00000100:00100000:2.0:1789498495.310970:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864592384 00000100:00100000:2.0:1789498495.311032:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:2.0:1789498495.311042:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:10298:x1876424864592384:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498495.311068:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498495.311123:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a046 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498495.311239:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789498495.311668:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18500 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a046 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.311697:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:2.0:1789498495.311700:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498495.311705:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a046 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.311721:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25200, rc 0) 00000100:00100000:2.0:1789498495.311799:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:10298:x1876424864592384:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 758us (1003us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1789498495.311806:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:1.0:1789498495.320762:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.320908:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864592640 00000100:00100000:2.0:1789498495.320919:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864592640 00000100:00100000:2.0:1789498495.320981:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:2.0:1789498495.320992:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:10298:x1876424864592640:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498495.321308:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:10298:x1876424864592640:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 317us (556us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789498495.321317:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498495.404183:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.404559:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864592768 00000100:00100000:3.0:1789498495.404572:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864592768 00000100:00100000:3.0:1789498495.404806:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:3.0:1789498495.404819:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:10304:x1876424864592768:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498495.404847:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498495.404869:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1850e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a04d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.404940:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.404955:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.404970:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498495.405008:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789498495.405012:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498495.405033:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.405060:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1850e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a04d expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.405080:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a04d expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.405177:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498495.405181:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498495.405198:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030000, rc 0) 00000100:00100000:3.0:1789498495.405262:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:10304:x1876424864592768:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 447us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498495.405270:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:0.0:1789498495.421442:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.423287:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864593024 00000100:00100000:3.0:1789498495.423304:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864593024 00000100:00100000:3.0:1789498495.423391:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:3.0:1789498495.423404:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:10304:x1876424864593024:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498495.423437:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498495.423463:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1851c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a054 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.423574:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18523 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.423589:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.423602:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498495.423613:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789498495.423759:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1851c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a054 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.423783:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a054 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.423792:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:3.0:1789498495.423809:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498495.423813:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80031600, rc 0) 00000100:00100000:3.0:1789498495.423887:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:10304:x1876424864593024:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 487us (2458us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789498495.423895:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:1.0:1789498495.427937:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498495.427990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.428228:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864593408 00000100:00100000:2.0:1789498495.428239:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864593408 00000100:00100000:2.0:1789498495.428299:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:2.0:1789498495.428310:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:10304:x1876424864593408:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498495.428335:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498495.428357:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18531 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a05b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.428470:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.428501:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.428515:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498495.428529:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789498495.428680:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18531 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a05b expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.428704:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a05b expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.428712:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498495.428715:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789498495.428719:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25c00, rc 0) 00000100:00100000:2.0:1789498495.428786:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:10304:x1876424864593408:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 477us (795us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789498495.428793:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:3.0:1789498495.429613:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864593152 00000100:00100000:3.0:1789498495.429622:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864593152 00000100:00100000:3.0:1789498495.429706:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1789498495.429716:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83735180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:2355:x1876424864593152:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498495.429736:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498495.429756:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a054 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.429771:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:3.0:1789498495.429775:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498495.429812:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83735180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:2355:x1876424864593152:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 98us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498495.429820:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:1.0:1789498495.440911:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.441131:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864593536 00000100:00100000:3.0:1789498495.441142:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864593536 00000100:00100000:3.0:1789498495.441212:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1789498495.441224:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864593536:12345-192.168.201.20@tcp:1:lfs.0 00010000:00010000:3.0:1789498495.441272:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.441295:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.441324:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789498495.441329:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498495.441335:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.441375:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.441391:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 7 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498495.441405:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1876424885601408:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498495.441499:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa055f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498495.446581:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.446663:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864593664 00000100:00100000:2.0:1789498495.446673:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864593664 00002000:00100000:2.0:1789498495.446726:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98eabaeee680 x1876424864593664/t0(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:526/0 lens 504/0 e 0 to 0 dl 1789498506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789498495.446737:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabaeee680 with x1876424864593664 ext(0->12) 00010000:00010000:2.0:1789498495.446747:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 8 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.446785:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 8 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789498495.446793:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98eabaeee680 00000100:00100000:2.0:1789498495.446830:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1789498495.446840:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864593664:12345-192.168.201.20@tcp:4:lfs.0 00000100:00100000:3.0:1789498495.448293:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1876424885601408:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498495.448324:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789498495.503944:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000100:00100000:3.0:1789498495.505126:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2356:x1876424864593664:12345-192.168.201.20@tcp:4:lfs.0 Request processed in 58241us (58508us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789498495.505290:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00002000:00100000:3.0:1789498495.505306:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98eabaeee680 x1876424864593664/t4294967299(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:526/0 lens 504/448 e 0 to 0 dl 1789498506 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789498495.505316:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabaeee680 with x1876424864593664 ext(0->12) 00010000:00010000:3.0:1789498495.505440:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 9 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.505522:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 9 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498495.505533:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98eabaeee680 00000100:00100000:0.0:1789498495.510370:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.510716:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864593792 00000100:00100000:3.0:1789498495.510733:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864593792 00010000:00010000:3.0:1789498495.510774:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 9 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498495.510808:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:3.0:1789498495.510816:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2358:x1876424864593792:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498495.510831:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789498495.510850:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789498495.510853:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789498494 00002000:00010000:3.0:1789498495.510856:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789498495 00002000:00010000:3.0:1789498495.510858:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789498494 00010000:00010000:3.0:1789498495.510864:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 9 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.510879:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 9 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.510904:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008af587dd/0x3a6cb1946bc184f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a03f expref: 9 pid: 6704 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.510939:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498495.510942:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498495.510947:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.510954:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.510980:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498495.511027:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2358:x1876424864593792:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 212us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498495.511035:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00010000:00010000:3.0:1789498495.511191:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.511203:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.511233:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.511242:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.511250:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.511264:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498495.511269:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.511280:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.511291:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.511299:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009587ffb2/0x3a6cb1946bc18546 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498495.511375:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864593536:12345-192.168.201.20@tcp:1:lfs.0 Request processed in 70153us (70490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498495.511384:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:0.0:1789498495.516362:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.516735:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864594048 00000100:00100000:2.0:1789498495.516744:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864594048 00000100:00100000:2.0:1789498495.516793:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498495.516800:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:10304:x1876424864594048:12345-192.168.201.20@tcp:35:lfs.0 00000004:00010000:2.0:1789498495.516871:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a05b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498495.517229:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789498495.517289:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789498495.519016:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789498495.519436:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.519527:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 23 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.519551:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.519591:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 23 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.519609:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 23 pid: 7250 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498495.519624:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1876424885601536:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498495.520021:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789498495.524881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.524972:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864594176 00000100:00100000:2.0:1789498495.524983:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864594176 00010000:00010000:2.0:1789498495.525026:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 24 pid: 7250 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498495.525065:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1789498495.525075:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2355:x1876424864594176:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498495.525213:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498495.525229:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 24 pid: 7250 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.525271:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 24 pid: 7250 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.525291:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498495.525295:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.525303:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.525308:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498495.525323:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498495.525377:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2355:x1876424864594176:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 304us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498495.525388:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00010000:00010000:0.0:1789498495.528577:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc184dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a031 expref: 23 pid: 7250 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498495.528608:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1876424885601536:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498495.528639:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.528713:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.528720:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498495.529022:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789498495.529591:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789498495.529773:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876424885601664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789498495.529905:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498495.529939:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498495.529971:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885601664 00000100:00100000:0.0:1789498495.529978:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885601664 00000100:00100000:0.0:1789498495.530031:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498495.530040:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876424885601664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789498495.530140:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876424885601664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498495.530148:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498495.530203:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876424885601664:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1789498495.530783:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789498495.531920:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789498495.532011:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876424885601792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789498495.532080:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498495.532214:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498495.533015:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885601792 00000100:00100000:2.0:1789498495.533027:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885601792 00000100:00100000:3.0:1789498495.533268:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498495.533278:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876424885601792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789498495.533890:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1876424885601792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 612us (1808us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789498495.533898:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498495.534086:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876424885601792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789498495.534237:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789498495.534350:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.534362:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.534370:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.534376:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498495.534381:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.534389:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.534405:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:1.0:1789498495.534408:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789498495.534413:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498495.534420:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1854d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789498495.534932:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789498495.536714:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789498495.536867:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395300775569ns, next at 396300770081ns, rc = 0 00000001:00080000:1.0:1789498495.536882:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789498495.536953:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:1.0:1789498495.536958:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789498495.536983:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a05b expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498495.537137:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:10304:x1876424864594048:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 20336us (20802us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789498495.537147:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000020:00080000:1.0:1789498495.537162:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789498495.541192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.541232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864594304 00000100:00100000:3.0:1789498495.541254:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864594304 00000100:00100000:3.0:1789498495.541304:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:3.0:1789498495.541315:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:10304:x1876424864594304:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498495.541341:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498495.541367:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a062 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.541433:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a062 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.541449:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a062 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.542121:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498495.542125:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498495.542129:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498495.542206:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:10304:x1876424864594304:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 892us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498495.542214:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:3.0:1789498495.547235:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498495.547526:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864594560 00000100:00100000:1.0:1789498495.547536:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864594560 00000100:00100000:1.0:1789498495.547620:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1789498495.547630:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5957c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:10304:x1876424864594560:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498495.547869:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5957c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:10304:x1876424864594560:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 240us (651us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789498495.547877:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1789498495.658697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.658848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864594816 00000100:00100000:3.0:1789498495.658860:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864594816 00000100:00100000:3.0:1789498495.658934:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:3.0:1789498495.658945:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:10314:x1876424864594816:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498495.658972:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498495.658993:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1855b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a069 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498495.659181:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789498495.659325:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1855b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a069 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.659339:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:3.0:1789498495.659342:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498495.659348:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1855b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a069 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.659365:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20da800, rc 0) 00000100:00100000:3.0:1789498495.659425:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:10314:x1876424864594816:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 482us (737us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789498495.659432:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:3.0:1789498495.668908:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498495.669015:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864594944 00000100:00100000:0.0:1789498495.669026:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864594944 00000100:00100000:0.0:1789498495.669113:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:0.0:1789498495.669123:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:10314:x1876424864594944:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:0.0:1789498495.669212:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669238:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669250:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669273:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669294:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669301:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669394:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669402:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669409:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498495.669455:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669468:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669475:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669482:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669488:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498495.669492:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669500:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669518:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498495.669521:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498495.669526:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669532:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669545:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669550:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669556:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669561:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498495.669564:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669569:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669576:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea84ebfe00) 00010000:00010000:0.0:1789498495.669578:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498495.669581:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669586:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669609:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669615:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669620:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669625:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498495.669628:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669633:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669653:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498495.669656:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498495.669659:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.669666:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498495.669746:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:10314:x1876424864594944:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 624us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498495.669754:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:0.0:1789498495.673613:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.673717:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864595200 00000100:00100000:2.0:1789498495.673737:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864595200 00000100:00100000:2.0:1789498495.673795:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498495.673805:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:10314:x1876424864595200:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498495.674055:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:10314:x1876424864595200:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 250us (453us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789498495.674063:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498495.717773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498495.717923:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864595456 00000100:00100000:3.0:1789498495.717935:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864595456 00000100:00100000:3.0:1789498495.717997:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:3.0:1789498495.718007:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:10317:x1876424864595456:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498495.718031:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498495.718050:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1857e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a070 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718173:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718189:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718214:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718239:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718247:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718255:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718401:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718409:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718415:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498495.718425:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789498495.718533:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718540:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718547:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718553:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498495.718563:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718572:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718586:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498495.718589:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498495.718595:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718602:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718618:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718624:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718630:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718635:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498495.718639:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718643:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718660:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea9108c000) 00010000:00010000:3.0:1789498495.718662:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498495.718671:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718677:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1858c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718731:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1857e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718747:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498495.718753:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498495.718755:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498495.718757:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db800, rc 0) 00000100:00100000:3.0:1789498495.718826:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:10317:x1876424864595456:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 819us (1062us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789498495.718833:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:3.0:1789498495.724049:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498495.724137:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864595584 00000100:00100000:0.0:1789498495.724146:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864595584 00000100:00100000:0.0:1789498495.724230:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1789498495.724241:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:10317:x1876424864595584:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:0.0:1789498495.724315:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724332:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724344:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724374:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724381:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724388:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724394:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498495.724398:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724405:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724418:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498495.724421:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789498495.724426:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498495.724443:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc185a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498495.724520:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:10317:x1876424864595584:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 281us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498495.724528:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1789498495.728569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498495.728671:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864595840 00000100:00100000:2.0:1789498495.728682:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864595840 00000100:00100000:2.0:1789498495.728748:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498495.728759:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:10317:x1876424864595840:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498495.729057:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:10317:x1876424864595840:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 300us (501us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789498495.729065:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00010000:00010000:3.0:1789498495.915289:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498496.090908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498496.091131:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864596096 00000100:00100000:3.0:1789498496.091152:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864596096 00000100:00100000:3.0:1789498496.091235:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:3.0:1789498496.091245:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:10348:x1876424864596096:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:3.0:1789498496.091284:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498496.091306:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a077 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.091417:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc185af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.091446:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc185af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.091458:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc185af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498496.091471:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789498496.091614:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a077 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.091855:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc185af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a077 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.091866:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498496.091869:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498496.091872:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db400, rc 0) 00000100:00100000:3.0:1789498496.091942:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:10348:x1876424864596096:12345-192.168.201.20@tcp:101:cat.0 Request processed in 698us (1053us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789498496.091950:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00080000:1.0:1789498496.092133:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498496.106347:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498496.106502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498496.107517:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864596480 00000100:00100000:0.0:1789498496.107529:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864596480 00000100:00100000:0.0:1789498496.107601:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:0.0:1789498496.107612:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85660050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:2356:x1876424864596480:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498496.107629:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498496.107667:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc185af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a077 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.107692:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498496.107698:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498496.107782:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85660050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:2356:x1876424864596480:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 172us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498496.107790:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:2.0:1789498496.110445:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864596352 00000100:00100000:2.0:1789498496.110464:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864596352 00000100:00100000:2.0:1789498496.110540:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:2.0:1789498496.110550:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:10348:x1876424864596352:12345-192.168.201.20@tcp:35:cat.0 00000100:00100000:2.0:1789498496.111067:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:10348:x1876424864596352:12345-192.168.201.20@tcp:35:cat.0 Request processed in 516us (4731us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789498496.111076:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:3.0:1789498496.200394:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498496.200540:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864596736 00000100:00100000:0.0:1789498496.200550:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864596736 00000100:00100000:0.0:1789498496.200616:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:0.0:1789498496.200625:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:10354:x1876424864596736:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1789498496.200660:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498496.200663:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789498496.200736:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a04d expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.200755:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498496.200759:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498496.200772:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc185bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a07e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.200870:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.200885:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.200894:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.200925:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.200939:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 35 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498496.200953:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885601920:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498496.201058:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498496.208244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498496.208496:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864596864 00000100:00100000:2.0:1789498496.208505:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864596864 00010000:00010000:2.0:1789498496.208544:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 36 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498496.208587:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:2.0:1789498496.208597:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+36:2355:x1876424864596864:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498496.208610:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498496.208618:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 36 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.208659:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 36 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.208680:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498496.208686:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.208696:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.208703:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.208734:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498496.208794:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+36:2355:x1876424864596864:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 198us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498496.208801:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00010000:00010000:3.0:1789498496.209518:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a070 expref: 35 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498496.209540:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885601920:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498496.209563:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.209583:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.209589:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498496.209608:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789498496.209897:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc185bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.209913:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.209922:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498496.209926:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789498496.209929:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5a00, rc 0) 00000100:00100000:3.0:1789498496.209982:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:10354:x1876424864596736:12345-192.168.201.20@tcp:101:dd.0 Request processed in 9357us (9598us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789498496.209991:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:0.0:1789498496.215894:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498496.215990:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864597120 00000100:00100000:2.0:1789498496.216000:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864597120 00000100:00100000:2.0:1789498496.216058:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:2.0:1789498496.216068:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:10354:x1876424864597120:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1789498496.216834:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.216853:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.216865:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498496.216932:0:7250:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789498496.216959:0:7250:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003dd46b9 reply state 0000000038760b28 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498496.216968:0:7250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498496.217165:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:10354:x1876424864597120:12345-192.168.201.20@tcp:36:dd.0 Request processed in 1097us (1279us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789498496.217174:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000020:00080000:2.0:1789498496.217179:0:7250:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789498496.227480:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.227524:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.227533:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.227539:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498496.227544:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.227551:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.227569:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498496.227573:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498496.227577:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.227583:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc185d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498496.648482:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498496.648773:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864597248 00000100:00100000:3.0:1789498496.648784:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864597248 00000100:00100000:3.0:1789498496.648844:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:3.0:1789498496.648856:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:10368:x1876424864597248:12345-192.168.201.20@tcp:101:stat.0 00010000:00010000:3.0:1789498496.648880:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498496.648899:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a085 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.648994:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649008:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649022:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649038:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649045:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649051:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649170:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649180:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649194:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649226:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.649252:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 38 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498496.649266:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885602048:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498496.649375:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa055f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498496.656777:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498496.656873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864597504 00000100:00100000:1.0:1789498496.656885:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864597504 00000100:00100000:1.0:1789498496.656946:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:1.0:1789498496.656957:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+39:5598:x1876424864597504:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789498496.657368:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:5598:x1876424864597504:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 412us (601us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789498496.657377:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498496.658515:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885602048:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498496.658547:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498496.659858:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498496.660128:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864597632 00000100:00100000:3.0:1789498496.660149:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864597632 00010000:00010000:3.0:1789498496.660190:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 40 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498496.660233:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498496.660243:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:2356:x1876424864597632:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498496.660258:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498496.660265:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 40 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.660278:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 40 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.660299:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc185c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a07e expref: 40 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.660337:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498496.660342:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.660353:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.660362:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.660382:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498496.660440:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+39:2356:x1876424864597632:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 197us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498496.660448:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00010000:00010000:2.0:1789498496.661913:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.661929:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498496.661987:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789498496.661992:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498496.662069:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662113:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662127:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662145:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662153:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662167:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498496.662172:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662181:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662195:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498496.662199:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498496.662203:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662209:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc185e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662226:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662232:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662237:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662242:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498496.662245:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662251:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662270:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea9108c000) 00010000:00010000:2.0:1789498496.662272:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498496.662276:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662282:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc185e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662331:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a085 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662347:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a085 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498496.662355:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498496.662357:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498496.662360:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbc00, rc 0) 00000100:00100000:2.0:1789498496.662497:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:10368:x1876424864597248:12345-192.168.201.20@tcp:101:stat.0 Request processed in 13643us (14027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498496.662507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:1.0:1789498496.753309:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498496.753442:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864597888 00000100:00100000:3.0:1789498496.753454:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864597888 00000100:00100000:3.0:1789498496.753516:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:3.0:1789498496.753526:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:10374:x1876424864597888:12345-192.168.201.20@tcp:36:truncate.0 00010000:00010000:3.0:1789498496.753598:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498496.753625:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc185ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a085 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.753647:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498496.753652:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498496.754319:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.754340:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.754364:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498496.754442:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789498496.754469:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2362f17 reply state 0000000010d3a836 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498496.754481:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498496.754685:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:10374:x1876424864597888:12345-192.168.201.20@tcp:36:truncate.0 Request processed in 1158us (1384us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789498496.754695:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 54 00000020:00080000:3.0:1789498496.754700:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789498496.756450:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498496.756466:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498496.756487:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498496.756493:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498496.756498:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498496.756506:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498496.756519:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498496.756522:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498496.756527:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498496.756533:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc185f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498496.939364:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498496.944009:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498496.944148:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864598016 00000100:00100000:0.0:1789498496.944160:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864598016 00000100:00100000:0.0:1789498496.944224:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:0.0:1789498496.944235:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+39:10388:x1876424864598016:12345-192.168.201.20@tcp:101:stat.0 00010000:00010000:0.0:1789498496.944272:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498496.944296:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc185fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a08c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944382:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944397:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944408:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944422:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944430:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944436:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944524:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944533:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944540:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498496.944582:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789498496.944587:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498496.944609:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944642:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944650:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944656:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944664:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944670:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498496.944675:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944682:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944694:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498496.944697:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498496.944702:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944708:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18603 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944721:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944727:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944739:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944744:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498496.944747:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944753:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944760:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea84ebfe00) 00010000:00010000:0.0:1789498496.944763:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498496.944765:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944770:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc1860a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944801:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc185fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944815:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498496.944822:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498496.944824:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789498496.944827:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4200, rc 0) 00000100:00100000:0.0:1789498496.944891:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:10388:x1876424864598016:12345-192.168.201.20@tcp:101:stat.0 Request processed in 658us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498496.944907:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:0.0:1789498497.052769:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.053075:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864598272 00000100:00100000:2.0:1789498497.053203:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864598272 00000100:00100000:2.0:1789498497.053368:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:2.0:1789498497.053381:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:10398:x1876424864598272:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498497.053407:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498497.053431:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a093 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498497.053578:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789498497.053889:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18618 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a093 expref: 42 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.053903:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:2.0:1789498497.053906:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498497.053911:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a093 expref: 42 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.053926:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25800, rc 0) 00000100:00100000:2.0:1789498497.054040:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+41:10398:x1876424864598272:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 662us (1280us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789498497.054048:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:1.0:1789498497.058439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.058523:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864598528 00000100:00100000:3.0:1789498497.058535:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864598528 00000100:00100000:3.0:1789498497.058598:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1789498497.058608:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+41:10398:x1876424864598528:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498497.059083:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+42:10398:x1876424864598528:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 475us (654us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789498497.059166:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1789498497.130604:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498497.130806:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864598784 00000100:00100000:0.0:1789498497.130823:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864598784 00000100:00100000:0.0:1789498497.130921:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:0.0:1789498497.130934:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+42:10404:x1876424864598784:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498497.130979:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498497.131008:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18626 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a09a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.131301:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.131321:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.131329:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.131374:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.131387:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 43 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498497.131402:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885602176:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498497.131523:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498497.150856:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.151161:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885602176:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498497.151193:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498497.151445:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864598912 00000100:00100000:1.0:1789498497.151454:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864598912 00010000:00010000:1.0:1789498497.151498:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 44 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498497.151535:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:1.0:1789498497.151543:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+44:2356:x1876424864598912:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498497.151556:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498497.151574:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 44 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498497.151583:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 44 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498497.151602:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a08c expref: 44 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498497.151618:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498497.151623:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498497.151633:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498497.151642:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498497.151676:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498497.151742:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:2356:x1876424864598912:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 199us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498497.151749:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00010000:00010000:0.0:1789498497.152361:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.152372:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498497.152398:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789498497.152599:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18626 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.152625:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.152633:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498497.152636:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789498497.152639:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5400, rc 0) 00000100:00100000:0.0:1789498497.152680:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:10404:x1876424864598784:12345-192.168.201.20@tcp:101:bash.0 Request processed in 21750us (22096us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789498497.152687:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:1.0:1789498497.159226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.159407:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864599168 00000100:00100000:3.0:1789498497.159418:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864599168 00000100:00100000:3.0:1789498497.159481:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:3.0:1789498497.159492:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:10404:x1876424864599168:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:3.0:1789498497.159813:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.159827:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.159837:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498497.159879:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789498497.159895:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a5bd021 reply state 0000000085902e61 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498497.159901:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498497.160194:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+46:10404:x1876424864599168:12345-192.168.201.20@tcp:36:bash.0 Request processed in 704us (980us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789498497.160202:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00000020:00080000:3.0:1789498497.160208:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789498497.162206:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.162221:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.162230:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.162236:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498497.162254:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.162262:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.162277:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498497.162280:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498497.162286:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.162292:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1863b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498497.171861:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.171962:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864599296 00000100:00100000:2.0:1789498497.171972:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864599296 00000100:00100000:2.0:1789498497.172035:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:2.0:1789498497.172046:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:10404:x1876424864599296:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498497.172070:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498497.172108:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18642 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0a1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.172206:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.172222:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.172243:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.172282:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.172295:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 46 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498497.172308:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885602304:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498497.172397:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498497.174461:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885602304:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498497.174491:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498497.175270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498497.175453:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864599424 00000100:00100000:0.0:1789498497.175464:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864599424 00010000:00010000:0.0:1789498497.175504:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 47 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498497.175547:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:0.0:1789498497.175557:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:2356:x1876424864599424:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498497.175573:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498497.175581:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 47 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.175593:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 47 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.175636:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1862d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a09a expref: 47 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.175653:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498497.175659:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.175668:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.175674:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.175717:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498497.175774:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+46:2356:x1876424864599424:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 218us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498497.175782:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00010000:00010000:2.0:1789498497.175996:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.176005:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498497.176057:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789498497.176062:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498497.176082:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.176162:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18642 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0a1 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.176177:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0a1 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.176195:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498497.176198:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498497.176201:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25800, rc 0) 00000100:00100000:2.0:1789498497.176240:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:10404:x1876424864599296:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4197us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498497.176247:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:1.0:1789498497.179925:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.180009:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864599680 00000100:00100000:2.0:1789498497.180019:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864599680 00000100:00100000:2.0:1789498497.180077:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:2.0:1789498497.180086:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5954450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:10404:x1876424864599680:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:2.0:1789498497.180381:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5954450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+46:10404:x1876424864599680:12345-192.168.201.20@tcp:35:bash.0 Request processed in 294us (474us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789498497.180389:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498497.288622:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.288788:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864599936 00000100:00100000:2.0:1789498497.288799:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864599936 00000100:00100000:2.0:1789498497.288861:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:2.0:1789498497.288872:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+46:10414:x1876424864599936:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498497.288896:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498497.288930:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0a8 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498497.289022:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789498497.289199:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18650 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0a8 expref: 48 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.289234:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:2.0:1789498497.289237:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498497.289243:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0a8 expref: 48 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.289257:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24e00, rc 0) 00000100:00100000:2.0:1789498497.289324:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10414:x1876424864599936:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 454us (724us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789498497.289331:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:1.0:1789498497.293061:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.293182:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864600064 00000100:00100000:3.0:1789498497.293193:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864600064 00000100:00100000:3.0:1789498497.293245:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:3.0:1789498497.293254:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10414:x1876424864600064:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:3.0:1789498497.293333:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293351:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293363:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293388:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293395:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293401:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293483:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293490:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293497:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498497.293541:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293553:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293559:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293567:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293572:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498497.293576:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293589:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293600:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498497.293603:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498497.293607:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293628:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1865e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293641:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293647:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293653:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293657:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498497.293660:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293665:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293672:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea9108cf00) 00010000:00010000:3.0:1789498497.293674:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498497.293676:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293690:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18665 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293705:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293711:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293716:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293720:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498497.293723:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293728:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293734:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498497.293736:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498497.293738:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.293744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1866c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498497.293822:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10414:x1876424864600064:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 569us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498497.293830:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:1.0:1789498497.306388:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.306475:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864600320 00000100:00100000:2.0:1789498497.306487:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864600320 00000100:00100000:2.0:1789498497.306540:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:2.0:1789498497.306549:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10414:x1876424864600320:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498497.306788:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+48:10414:x1876424864600320:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 239us (413us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789498497.306796:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498497.374032:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.374414:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864600576 00000100:00100000:2.0:1789498497.374427:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864600576 00000100:00100000:2.0:1789498497.374506:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:2.0:1789498497.374518:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+48:10417:x1876424864600576:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498497.374549:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498497.374574:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0af expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.374704:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.374726:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.374739:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.374760:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.374768:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.374774:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.374897:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18688 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376278:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376295:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498497.376310:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789498497.376436:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376444:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376450:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376466:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498497.376470:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376478:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376490:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498497.376493:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498497.376498:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376504:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc1867a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376521:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376527:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376533:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376539:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498497.376542:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376548:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376567:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98eaa1d46100) 00010000:00010000:2.0:1789498497.376569:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498497.376573:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.376579:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.379897:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0af expref: 51 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.379939:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0af expref: 50 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.379949:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498497.379952:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498497.379955:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25200, rc 0) 00000100:00100000:3.0:1789498497.380029:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10417:x1876424864600576:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 5513us (6010us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789498497.380038:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:1.0:1789498497.392797:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.392927:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864600704 00000100:00100000:3.0:1789498497.392943:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864600704 00000100:00100000:3.0:1789498497.393038:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:3.0:1789498497.393052:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10417:x1876424864600704:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:3.0:1789498497.393199:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393223:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393238:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393276:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393283:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393311:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393319:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498497.393324:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393333:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393348:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498497.393352:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498497.393358:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.393365:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498497.393469:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10417:x1876424864600704:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 420us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498497.393478:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:2.0:1789498497.401883:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.413447:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864600832 00000100:00100000:3.0:1789498497.413469:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864600832 00000100:00100000:3.0:1789498497.414154:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498497.414170:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:2355:x1876424864600832:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498497.414192:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498497.414225:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0af expref: 50 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.414277:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498497.414284:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498497.414421:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+49:2355:x1876424864600832:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 255us (12557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498497.414430:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1789498497.415405:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498497.415689:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864601088 00000100:00100000:1.0:1789498497.415702:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864601088 00000100:00100000:1.0:1789498497.415776:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:1.0:1789498497.415787:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+49:10417:x1876424864601088:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498497.416393:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10417:x1876424864601088:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 607us (996us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789498497.416401:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:1.0:1789498497.431505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498497.431553:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498497.431592:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.431675:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864601216 00000100:00100000:3.0:1789498497.431685:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864601216 00000100:00100000:3.0:1789498497.431750:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 290 00000100:00100000:0.0:1789498497.431757:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864601344 00000100:00100000:3.0:1789498497.431771:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864601216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498497.431771:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864601344 00000100:00100000:3.0:1789498497.431852:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864601216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498497.431865:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:3.0:1789498497.431867:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 290 00000100:00100000:0.0:1789498497.431888:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2357:x1876424864601344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498497.431955:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2357:x1876424864601344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 77us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498497.431963:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00080000:1.0:1789498497.432034:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498497.434286:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864601472 00000100:00100000:2.0:1789498497.434299:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864601472 00000100:00100000:2.0:1789498497.434389:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 145 00000100:00080000:1.0:1789498497.434389:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498497.434400:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864601472:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498497.434468:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864601472:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498497.434475:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 145 00000100:00100000:2.0:1789498497.616808:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.616957:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864601728 00000100:00100000:3.0:1789498497.616966:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864601728 00000100:00100000:3.0:1789498497.617023:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:3.0:1789498497.617032:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10435:x1876424864601728:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:3.0:1789498497.617055:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498497.617075:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1869d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0b6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.617227:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.617242:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.617271:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498497.617283:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789498497.617421:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1869d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0b6 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.617441:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0b6 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.617449:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498497.617452:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789498497.617456:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db000, rc 0) 00000100:00100000:3.0:1789498497.617526:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10435:x1876424864601728:12345-192.168.201.20@tcp:101:cat.0 Request processed in 494us (728us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789498497.617533:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:3.0:1789498497.644156:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.644273:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864601856 00000100:00100000:2.0:1789498497.644286:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864601856 00000100:00100000:2.0:1789498497.644350:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:2.0:1789498497.644361:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10436:x1876424864601856:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498497.644389:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498497.644410:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc186b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0bd expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.644484:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc186b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.644514:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc186b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.644527:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc186b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498497.644569:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789498497.644573:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498497.644591:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc186b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.644620:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc186b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0bd expref: 54 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.644642:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc186b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0bd expref: 53 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.644652:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498497.644654:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498497.644658:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25200, rc 0) 00000100:00100000:2.0:1789498497.644728:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10436:x1876424864601856:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 370us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498497.644735:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:1.0:1789498497.652010:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.652113:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864602240 00000100:00100000:2.0:1789498497.652132:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864602240 00000100:00100000:2.0:1789498497.652190:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:2.0:1789498497.652200:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10436:x1876424864602240:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498497.652655:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10436:x1876424864602240:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 455us (653us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789498497.652679:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:1.0:1789498497.656654:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498497.656865:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864602368 00000100:00100000:0.0:1789498497.656874:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864602368 00000100:00100000:0.0:1789498497.656952:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1789498497.656962:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10436:x1876424864602368:12345-192.168.201.20@tcp:103:lfs.0 00010000:00010000:0.0:1789498497.656975:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789498497.656997:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0a1 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.657015:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0b6 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.657023:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a062 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498497.657030:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498497.657040:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498497.657086:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+51:10436:x1876424864602368:12345-192.168.201.20@tcp:103:lfs.0 Request processed in 127us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498497.657188:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:2.0:1789498497.661490:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498497.664045:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864602496 00000100:00100000:3.0:1789498497.664060:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864602496 00000100:00100000:3.0:1789498497.664154:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:3.0:1789498497.664162:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+51:10436:x1876424864602496:12345-192.168.201.20@tcp:58:lfs.0 00010000:00010000:3.0:1789498497.664275:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.664288:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498497.664297:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498497.664529:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498497.664729:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789498497.664800:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789498497.664899:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+51:10436:x1876424864602496:12345-192.168.201.20@tcp:58:lfs.0 Request processed in 736us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498497.664907:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:1.0:1789498497.710322:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498497.710471:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864602624 00000100:00100000:2.0:1789498497.710481:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864602624 00000100:00100000:2.0:1789498497.710536:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:2.0:1789498497.710546:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+51:10438:x1876424864602624:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498497.710566:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498497.710586:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc186c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0c4 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710651:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710664:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710674:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710688:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710695:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710701:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710915:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710935:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.710941:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498497.710978:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789498497.710983:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498497.710999:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711010:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711018:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711025:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711033:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711039:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498497.711043:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711050:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711061:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498497.711064:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498497.711075:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711082:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc186ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711142:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711148:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711153:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711158:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498497.711161:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711165:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711173:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98eaa1d46100) 00010000:00010000:2.0:1789498497.711175:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498497.711178:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711183:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc186d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711212:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc186c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 53 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711239:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 52 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498497.711246:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108cf00) 00010000:00010000:2.0:1789498497.711248:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498497.711251:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24600, rc 0) 00000100:00100000:2.0:1789498497.711310:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10438:x1876424864602624:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 766us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498497.711317:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00010000:00010000:3.0:1789498497.963975:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498498.027353:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498498.027364:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498498.027429:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789498498.027436:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789498498.027570:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885602432:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789498498.027676:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498498.033248:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885602432:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789498498.056192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.058018:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864602752 00000100:00100000:2.0:1789498498.058042:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864602752 00000100:00100000:2.0:1789498498.060450:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:2.0:1789498498.060473:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10450:x1876424864602752:12345-192.168.201.20@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789498498.060582:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10450:x1876424864602752:12345-192.168.201.20@tcp:900:lhsmtool_posix.0 Request processed in 118us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.060590:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00080000:1.0:1789498498.062545:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498498.069552:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.069622:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864602880 00000100:00100000:3.0:1789498498.069632:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864602880 00000100:00100000:3.0:1789498498.069688:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1789498498.069699:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10450:x1876424864602880:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498498.069746:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498498.069874:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10450:x1876424864602880:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 176us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.069882:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:0.0:1789498498.074968:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.075969:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864603008 00000100:00100000:3.0:1789498498.075982:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864603008 00000100:00100000:3.0:1789498498.076049:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:3.0:1789498498.076060:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10450:x1876424864603008:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.076166:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076184:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076196:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076227:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076235:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076242:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076271:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076280:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076287:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498498.076331:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789498498.076335:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498498.076352:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076363:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076666:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076676:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076757:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.076762:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076769:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076782:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:3.0:1789498498.076784:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.076790:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076862:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc186e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076879:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076885:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076891:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076895:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbe00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.076898:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076905:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076923:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff98ea9108cd00) 00010000:00010000:3.0:1789498498.076926:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.076929:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076934:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc186ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076950:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076957:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076962:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076967:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.076970:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076975:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076982:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108cf00) 00010000:00010000:3.0:1789498498.076984:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.076987:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.076992:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc186f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.077085:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10450:x1876424864603008:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 Request processed in 1027us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.077125:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:1.0:1789498498.082486:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.082693:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864603264 00000100:00100000:3.0:1789498498.082704:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864603264 00000100:00100000:3.0:1789498498.082764:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:3.0:1789498498.082782:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10450:x1876424864603264:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.082907:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498498.082928:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc186f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0cb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.083029:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.083045:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.083057:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498498.083068:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789498498.086041:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086056:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086063:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086070:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498498.086074:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086258:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086279:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108cf00) 00010000:00010000:1.0:1789498498.086283:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498498.086289:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086296:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc186ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086365:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc186f8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0cb expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086377:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:1.0:1789498498.086379:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498498.086383:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc186f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0cb expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.086394:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbc00, rc 0) 00000100:00100000:1.0:1789498498.086468:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10450:x1876424864603264:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 3688us (3991us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789498498.086478:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:1.0:1789498498.100807:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.100903:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864603392 00000100:00100000:3.0:1789498498.100914:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864603392 00000100:00100000:3.0:1789498498.100975:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:3.0:1789498498.100987:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10450:x1876424864603392:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498498.101024:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498498.101166:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10450:x1876424864603392:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 182us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.101185:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:0.0:1789498498.106339:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.106430:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864603648 00000100:00100000:3.0:1789498498.106441:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864603648 00000100:00100000:3.0:1789498498.106494:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:3.0:1789498498.106505:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10450:x1876424864603648:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.106527:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498498.106530:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789498498.106556:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc186b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0bd expref: 53 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.106574:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498498.106578:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498498.106591:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc1870d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0d2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789498498.107332:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789498498.107560:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.107573:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.107583:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.107643:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc1870d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d2 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.107672:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d2 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.107680:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108cd00) 00010000:00010000:3.0:1789498498.107683:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498498.107685:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498498.107751:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10450:x1876424864603648:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1248us (1423us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789498498.108954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:0.0:1789498498.115042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.116955:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864603904 00000100:00100000:3.0:1789498498.116972:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864603904 00000100:00100000:3.0:1789498498.117162:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:3.0:1789498498.117174:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10450:x1876424864603904:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.117230:0:7250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498498.117256:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d2 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117279:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108cd00) 00010000:00010000:3.0:1789498498.117291:0:7250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498498.117311:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117325:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117334:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117362:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117369:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117376:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117443:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117452:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117458:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117464:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.117468:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117476:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117485:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498498.117488:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.117491:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117497:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18722 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117516:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117522:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117527:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117532:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.117535:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117541:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117548:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf17bcdff (ffff98ea9108c800) 00010000:00010000:3.0:1789498498.117550:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.117553:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.117558:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18729 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf17bcdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.117649:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10450:x1876424864603904:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 477us (2616us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498498.117657:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:0.0:1789498498.120078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.120703:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864604032 00000100:00100000:3.0:1789498498.120713:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864604032 00000100:00100000:3.0:1789498498.120781:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:3.0:1789498498.120803:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10450:x1876424864604032:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.120825:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498498.120849:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18730 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0d9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.120885:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.120898:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.120910:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.121004:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.121021:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.121029:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:3.0:1789498498.121032:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789498498.121035:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030000, rc 0) 00000100:00100000:3.0:1789498498.121118:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10450:x1876424864604032:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 288us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.121126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:0.0:1789498498.124583:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.124728:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864604288 00000100:00100000:3.0:1789498498.124739:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864604288 00000100:00100000:3.0:1789498498.124873:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:3.0:1789498498.124891:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10450:x1876424864604288:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.124984:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.125000:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.125012:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498498.125350:0:7250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789498498.125360:0:7250:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397889269019ns, next at 398889267094ns, rc = 0 00000004:00010000:3.0:1789498498.125449:0:7250:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000142d9aa6 reply state 00000000fbb516c1 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.125458:0:7250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498498.125560:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10450:x1876424864604288:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 670us (984us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789498498.125568:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:0.0:1789498498.131374:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:1.0:1789498498.131818:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.131832:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.131848:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.131854:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498498.131859:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.131867:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864604416 00010000:00010000:1.0:1789498498.131868:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.131877:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864604416 00010000:00010000:1.0:1789498498.131883:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:1.0:1789498498.131886:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789498498.131890:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.131895:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030a00/0x3a6cb1946bc1873e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.131929:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:3.0:1789498498.131939:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10450:x1876424864604416:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.131961:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498498.131978:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0e0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.132039:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.132065:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.132127:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:3.0:1789498498.132131:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498498.132134:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80031600, rc 0) 00000100:00100000:3.0:1789498498.132193:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10450:x1876424864604416:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 256us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.132200:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:1.0:1789498498.138519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.142436:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864604544 00000100:00100000:2.0:1789498498.142454:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864604544 00000100:00100000:2.0:1789498498.142510:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:2.0:1789498498.142519:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876424864604544:12345-192.168.201.20@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789498498.142558:0:6702:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:2.0:1789498498.142607:0:6702:0:(genops.c:1384:class_connect()) connect: client 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c, cookie 0x3a6cb1946bc1874c 00002000:00100000:2.0:1789498498.142619:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c/ffff98eaba3b3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789498498.142646:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789498498.142908:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789498498.142942:0:6702:0:(import.c:65:import_set_state_nolock()) ffff98eaba3b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498498.143033:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2354:x1876424864604544:12345-192.168.201.20@tcp:8:lhsmtool_posix.0 Request processed in 513us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.143041:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:2.0:1789498498.148062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.148227:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864604672 00000100:00100000:3.0:1789498498.148238:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864604672 00000100:00100000:3.0:1789498498.148315:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:3.0:1789498498.148325:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:0:x1876424864604672:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789498498.148901:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498498.200586:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:0:x1876424864604672:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 52250us (52520us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789498498.200668:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000001:00100000:1.0:1789498498.200774:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000001:00080000:1.0:1789498498.200793:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1789498498.213856:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.213949:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864604928 00000100:00100000:0.0:1789498498.213959:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864604928 00000100:00100000:0.0:1789498498.214014:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:0.0:1789498498.214023:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10450:x1876424864604928:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789498498.214276:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:10450:x1876424864604928:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 253us (430us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789498498.214284:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1789498498.216162:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.216193:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864605184 00000100:00100000:3.0:1789498498.216200:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864605184 00000100:00100000:3.0:1789498498.216242:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:3.0:1789498498.216252:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:10450:x1876424864605184:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789498498.216439:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:10450:x1876424864605184:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 188us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.216447:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:1.0:1789498498.224289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.225965:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864605312 00000100:00100000:0.0:1789498498.225983:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864605312 00000100:00100000:0.0:1789498498.226118:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:0.0:1789498498.226130:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:10450:x1876424864605312:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498498.226155:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498498.226181:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0e7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.226266:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc1875a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.226283:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc1875a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.226296:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc1875a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498498.226349:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498498.226369:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc1875a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.226396:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e7 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.226411:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc1875a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e7 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.226420:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:0.0:1789498498.226423:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789498498.226427:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5e00, rc 0) 00000100:00100000:0.0:1789498498.226495:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+58:10450:x1876424864605312:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 367us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498498.226502:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:1.0:1789498498.229520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.229561:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864605440 00000100:00100000:3.0:1789498498.229571:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864605440 00000100:00100000:3.0:1789498498.229626:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:3.0:1789498498.229637:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864605440:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.229663:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498498.229685:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498498.229712:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa99481, blocks: 0x1 00010000:00010000:3.0:1789498498.229731:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1789498498.229735:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498498.229744:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 6 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.229996:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 6 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.230009:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea80030a00, rc 0) 00000100:00100000:3.0:1789498498.230067:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864605440:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 432us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.230074:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:3.0:1789498498.232648:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.232810:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864605696 00000100:00100000:0.0:1789498498.232820:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864605696 00000100:00100000:0.0:1789498498.232875:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:0.0:1789498498.232885:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+58:10450:x1876424864605696:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789498498.232979:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+58:10450:x1876424864605696:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 97us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498498.232985:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1789498498.235518:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.235581:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864605824 00000100:00100000:0.0:1789498498.235589:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864605824 00000100:00100000:0.0:1789498498.235711:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1789498498.235727:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:10450:x1876424864605824:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498498.235743:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498498.235760:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0f5 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.235793:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.235802:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498498.235806:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498498.235812:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.235843:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.235857:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 7 pid: 6702 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.235873:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6704:1876424885602560:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498498.235964:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498498.237727:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6704:1876424885602560:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498498.237763:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.237786:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4400, rc 0) 00000100:00100000:2.0:1789498498.237845:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:10450:x1876424864605824:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 2118us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.237853:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1789498498.238320:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.238483:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864605952 00000100:00100000:0.0:1789498498.238491:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864605952 00010000:00010000:0.0:1789498498.238522:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 7 pid: 6702 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.238571:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:0.0:1789498498.238581:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85662050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864605952:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498498.238594:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498498.238685:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 7 pid: 6702 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.238696:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 7 pid: 6702 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.238716:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009587ffb2/0x3a6cb1946bc18761 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0ee expref: 7 pid: 6702 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.238727:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789498498.238730:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498498.238735:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.238742:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.238767:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.238780:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1876424885602688:192.168.201.20@tcp:105: 00000100:00100000:0.0:1789498498.238849:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498498.241926:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1876424885602688:192.168.201.20@tcp:105: 00010000:00010000:3.0:1789498498.241952:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498498.242015:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85662050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864605952:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 3434us (3694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.242026:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:2.0:1789498498.243467:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.243523:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864606080 00000100:00100000:0.0:1789498498.243532:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864606080 00002000:00100000:0.0:1789498498.243568:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98eab9fa5500 x1876424864606080/t0(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:529/0 lens 504/0 e 0 to 0 dl 1789498509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789498498.243576:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eab9fa5500 with x1876424864606080 ext(0->8) 00002000:00010000:0.0:1789498498.243580:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eab9fa5500 00000100:00100000:0.0:1789498498.243663:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1789498498.243671:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864606080:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789498498.244267:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864606080:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 Request processed in 595us (802us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789498498.244275:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00002000:00100000:0.0:1789498498.244283:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98eab9fa5500 x1876424864606080/t4294967302(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:529/0 lens 504/448 e 0 to 0 dl 1789498509 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789498498.244290:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eab9fa5500 with x1876424864606080 ext(0->8) 00002000:00010000:0.0:1789498498.244294:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eab9fa5500 00000100:00100000:3.0:1789498498.246403:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.246464:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864606208 00000100:00100000:2.0:1789498498.246474:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864606208 00000100:00100000:2.0:1789498498.246535:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:2.0:1789498498.246545:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+58:10450:x1876424864606208:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789498498.280957:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1789498498.280984:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98eaba6a33c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789498498.280989:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea83e15e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98ea8c2940c0 00000020:00080000:1.0:1789498498.280991:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea83e15b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98eabb499000 00000020:00080000:3.0:1789498498.281036:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:1.0:1789498498.281036:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789498498.281210:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789498498.281358:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10450:x1876424864606208:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 Request processed in 34808us (34958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.281367:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:2.0:1789498498.281403:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885602816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789498498.281454:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498498.281495:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885602816 00000100:00100000:3.0:1789498498.281502:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885602816 00000100:00100000:3.0:1789498498.281574:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498498.281583:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876424885602816:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1789498498.281654:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789498498.281782:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00002000:00080000:3.0:1789498498.281957:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789498498.282002:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa9947e, atime: 0x6aa9947f, ctime: 0x6aa9947e, blocks: 0x1 00010000:00010000:3.0:1789498498.282011:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.282035:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:3.0:1789498498.282039:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498498.282051:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.282068:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.282086:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.282148:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.282166:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789498498.282419:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885602944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789498498.282458:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498498.282533:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885602944 00000100:00100000:2.0:1789498498.282538:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885602944 00000100:00100000:2.0:1789498498.282585:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498498.282593:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885602944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789498498.282740:0:10445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789498498.282744:0:10445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789498497 00002000:00010000:2.0:1789498498.282746:0:10445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789498498.282748:0:10445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789498497 -> 1789498497 00002000:00010000:2.0:1789498498.282750:0:10445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789498498.282788:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885602944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (328us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789498498.282795:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1789498498.282836:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eab9fa5180/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789498498.282842:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885602944:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789498498.282929:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498498.284276:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.284356:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864606336 00000100:00100000:2.0:1789498498.284364:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864606336 00000100:00100000:2.0:1789498498.284433:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:2.0:1789498498.284441:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864606336:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789498498.284960:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876424885602816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3375us (3502us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789498498.284981:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:1.0:1789498498.284996:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eab9fbc380/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789498498.285003:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885602816:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789498498.285013:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498498.285021:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.285039:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498498.285044:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.285055:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.285082:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.285129:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc1876f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.285153:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498498.285155:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498498.285157:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789498498.304008:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1789498498.304268:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864606336:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 Request processed in 19823us (19992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.304279:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000001:00080000:1.0:1789498498.305028:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1789498498.306698:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.306753:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864606592 00000100:00100000:3.0:1789498498.306763:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864606592 00000100:00100000:3.0:1789498498.306821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:3.0:1789498498.306831:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:10450:x1876424864606592:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.306883:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498498.306925:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc1875a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e7 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.306945:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:3.0:1789498498.306950:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498498.306980:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.306994:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.307003:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498498.307345:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071906cbd reply state 0000000037bfbfb7 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.307354:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498498.307447:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:10450:x1876424864606592:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 617us (754us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789498498.307455:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00010000:00010000:0.0:1789498498.309032:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.309046:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.309054:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.309077:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498498.309082:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.309128:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.309143:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:0.0:1789498498.309146:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498498.309152:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.309158:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18776 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.309444:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.309520:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864606720 00000100:00100000:2.0:1789498498.309528:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864606720 00000100:00100000:2.0:1789498498.309591:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1789498498.309599:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864606720:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789498498.309826:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789498498.309830:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789498497 -> 1789498496 00002000:00010000:2.0:1789498498.309832:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789498495 00002000:00010000:2.0:1789498498.309835:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789498497 -> 1789498496 00002000:00010000:2.0:1789498498.309838:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789498498.309897:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864606720:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 297us (455us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789498498.309905:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1789498498.311807:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.311877:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864606976 00000100:00100000:0.0:1789498498.311885:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864606976 00000100:00100000:0.0:1789498498.311934:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:0.0:1789498498.311941:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:10450:x1876424864606976:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789498498.311996:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.312009:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.312017:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.312057:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.312069:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 13 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.312080:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885603072:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498498.312201:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea83717180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498498.317293:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.317324:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864607104 00000100:00100000:0.0:1789498498.317333:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864607104 00010000:00010000:0.0:1789498498.317380:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 14 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.317420:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:0.0:1789498498.317431:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2355:x1876424864607104:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498498.317447:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498498.317454:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 14 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.317468:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 14 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.317490:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:0.0:1789498498.317497:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.317518:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.317527:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.317549:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498498.317617:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2355:x1876424864607104:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 188us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498498.317624:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00010000:00010000:3.0:1789498498.318066:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80030000/0x3a6cb1946bc18737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0d9 expref: 13 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.318081:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885603072:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498498.318135:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318146:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318157:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318190:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318197:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318204:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318211:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.318216:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318223:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318233:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:3.0:1789498498.318236:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789498498.318240:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.318246:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1877d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.318364:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:10450:x1876424864606976:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 Request processed in 6422us (6563us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789498498.318373:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:0.0:1789498498.326505:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.326584:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864607232 00000100:00100000:3.0:1789498498.326595:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864607232 00000100:00100000:3.0:1789498498.326662:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1789498498.326682:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864607232:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.326734:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.326757:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.326767:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498498.326772:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498498.326778:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.326816:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.326830:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 7 pid: 6704 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.326845:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1876424885603200:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498498.326924:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba59d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789498498.329730:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1876424885603200:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498498.329761:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.331471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.331705:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864607360 00000100:00100000:3.0:1789498498.331716:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864607360 00010000:00010000:3.0:1789498498.331752:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 8 pid: 6704 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.331793:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:3.0:1789498498.331802:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864607360:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498498.331817:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498498.331843:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 8 pid: 6704 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.331857:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 8 pid: 6704 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.331880:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc18768 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0f5 expref: 8 pid: 6704 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.331894:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498498.331899:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498498.331904:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.331914:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.331960:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498498.332008:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864607360:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 207us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.332015:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00010000:00010000:1.0:1789498498.332120:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.332131:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.332158:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.332165:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.332173:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.332179:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498498.332183:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.332199:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.332213:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.332220:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18784 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498498.332270:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864607232:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 Request processed in 5599us (5777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498498.332278:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:0.0:1789498498.335497:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.335578:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864607616 00000100:00100000:3.0:1789498498.335588:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864607616 00000100:00100000:3.0:1789498498.335651:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:3.0:1789498498.335660:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:10450:x1876424864607616:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789498498.335735:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.335754:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.335765:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.335969:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.335981:0:7250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.335989:0:7250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.336019:0:7250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.336043:0:7250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 13 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.336056:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885603328:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498498.336162:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba59d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789498498.339878:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.339952:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864607744 00000100:00100000:2.0:1789498498.339962:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864607744 00010000:00010000:2.0:1789498498.340001:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 14 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498498.340041:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:2.0:1789498498.340051:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2356:x1876424864607744:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498498.340067:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498498.340074:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 14 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.340114:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 14 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.340136:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:2.0:1789498498.340142:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.340150:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.340163:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.340182:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498498.340233:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2356:x1876424864607744:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 183us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.340241:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00010000:00010000:1.0:1789498498.340446:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea80031600/0x3a6cb1946bc18745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0e0 expref: 13 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498498.340463:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885603328:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498498.340487:0:7250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.340497:0:7250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.340503:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789498498.340716:0:7250:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789498498.340888:0:7250:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789498498.340938:0:7250:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789498498.341019:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabafadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7250:1876424885603456:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789498498.341068:0:7250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498498.341137:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea90bec540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498498.341279:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885603456 00000100:00100000:3.0:1789498498.341285:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885603456 00000100:00100000:3.0:1789498498.341325:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498498.341333:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7250:x1876424885603456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789498498.341410:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7250:x1876424885603456:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.341417:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498498.341446:0:7250:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789498498.341451:0:7250:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eab9fa5180, transno 4294967303 00000100:00100000:3.0:1789498498.341464:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabafadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7250:1876424885603456:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789498498.341955:0:7250:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789498498.342014:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7250:1876424885603584:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789498498.342044:0:7250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498498.342063:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6bad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789498498.342285:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885603584 00000100:00100000:3.0:1789498498.342290:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885603584 00000100:00100000:3.0:1789498498.342311:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498498.342318:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7250:x1876424885603584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789498498.342473:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7250:x1876424885603584:12345-0@lo:1000:mdt00_003.0 Request processed in 155us (428us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789498498.342485:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498498.342518:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7250:1876424885603584:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789498498.342549:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342559:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342566:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342572:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbe00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.342577:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342586:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342602:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:3.0:1789498498.342606:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498498.342610:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342616:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18792 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342653:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342660:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342676:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342681:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.342684:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342690:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342698:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108cf00) 00010000:00010000:3.0:1789498498.342701:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498498.342704:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342710:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc186c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342732:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342745:0:7250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 16 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342753:0:7250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342779:0:7250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 16 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.342803:0:7250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 16 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.342815:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885603712:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498498.342864:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6bad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789498498.345412:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885603712:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498498.345442:0:7250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498498.354628:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.354909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864607872 00000100:00100000:0.0:1789498498.354920:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864607872 00010000:00010000:0.0:1789498498.354969:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 17 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.355028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:0.0:1789498498.355038:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:2355:x1876424864607872:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498498.355060:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498498.355068:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 17 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355119:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 17 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355166:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc186dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0c4 expref: 17 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355185:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108cf00) 00010000:00010000:0.0:1789498498.355192:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355206:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355214:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355242:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498498.355309:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:2355:x1876424864607872:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 266us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498498.355316:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00010000:00010000:0.0:1789498498.355349:0:7250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355357:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355454:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355463:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355470:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355482:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498498.355493:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355502:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355515:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108cf00) 00010000:00010000:0.0:1789498498.355518:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498498.355522:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355527:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18799 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355543:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355550:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355556:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355560:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498498.355563:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355573:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355590:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108cf00) 00010000:00010000:0.0:1789498498.355660:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789498498.355665:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.355672:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1878b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.356056:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:10450:x1876424864607616:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 20389us (20561us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789498498.356064:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000020:00080000:0.0:1789498498.356068:0:7250:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789498498.356285:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789498498.356289:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498498.356318:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789498498.356324:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789498498.362896:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.363126:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864608128 00000100:00100000:2.0:1789498498.363137:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864608128 00000100:00100000:2.0:1789498498.363192:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498498.363202:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:10450:x1876424864608128:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789498498.363946:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789498498.364056:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789498498.364134:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.364151:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.364163:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.364173:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.364180:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.364186:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.364211:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789498498.364311:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:10450:x1876424864608128:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 1108us (1424us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789498498.364320:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000020:00080000:2.0:1789498498.364326:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498498.366178:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498498.366191:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.366201:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498498.366204:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.366214:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.366229:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498498.366233:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789498498.366238:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.366248:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc187a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.366280:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498498.366282:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498498.366284:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498498.479315:0:12010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789498498.479323:0:12010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498498.479365:0:12010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789498498.479372:0:12010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789498498.539275:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885603968:0@lo:400:kworker.0 00000100:00100000:2.0:1789498498.539352:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498498.539417:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498498.539424:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885604096:0@lo:400:kworker.0 00000100:00100000:2.0:1789498498.539448:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498498.539483:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885603968 00000100:00100000:2.0:1789498498.539491:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885603968 00000100:00100000:2.0:1789498498.539533:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885604096 00000100:00100000:2.0:1789498498.539536:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885604096 00000100:00100000:2.0:1789498498.539567:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789498498.539576:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885603968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498498.539643:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885603968:12345-0@lo:400:kworker.0 Request processed in 67us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.539651:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789498498.539666:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789498498.539888:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885603840:0@lo:400:kworker.0 00000100:00100000:3.0:1789498498.539921:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498498.539947:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498498.539953:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885604224:0@lo:400:kworker.0 00000100:00100000:3.0:1789498498.539975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498498.539995:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885604224 00000100:00100000:3.0:1789498498.539998:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885604224 00000100:00100000:2.0:1789498498.540086:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885604096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498498.540154:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885604096:12345-0@lo:400:kworker.0 Request processed in 71us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.541453:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789498498.541465:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885604224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498498.541519:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885604224:12345-0@lo:400:kworker.0 Request processed in 59us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.541526:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789498498.541549:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885603840 00000100:00100000:3.0:1789498498.541555:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885603840 00000100:00100000:3.0:1789498498.541583:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789498498.541658:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885603840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498498.541766:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3306:x1876424885603840:12345-0@lo:400:kworker.0 Request processed in 177us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.541773:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789498498.541896:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885604224:0@lo:400:kworker.0 00000100:00100000:3.0:1789498498.541907:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec95aa81-4721-4a06-ac30-039c6a8f6732:3306:1876424885603840:0@lo:400:kworker.0 00000100:00100000:2.0:1789498498.541981:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1789498498.542004:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498498.542028:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885604096:0@lo:400:kworker.0 00000100:00100000:2.0:1789498498.542039:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885603968:0@lo:400:kworker.0 00000100:00100000:0.0:1789498498.564299:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498498.571216:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864608384 00000100:00100000:1.0:1789498498.571234:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864608384 00000100:00100000:1.0:1789498498.571303:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:1.0:1789498498.571315:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:10460:x1876424864608384:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498498.571653:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498498.571938:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc187a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a0fc expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.572043:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc187ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.572059:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc187ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.572071:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc187ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498498.572430:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789498498.577744:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc187a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0fc expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.577770:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc187ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0fc expref: 19 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.577780:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498498.577783:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789498498.577787:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde000, rc 0) 00000100:00100000:0.0:1789498498.577946:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:10460:x1876424864608384:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 6632us (13654us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789498498.577955:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:2.0:1789498498.588263:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.590835:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864608512 00000100:00100000:0.0:1789498498.590854:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864608512 00000100:00100000:0.0:1789498498.590979:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1789498498.590991:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:10460:x1876424864608512:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:0.0:1789498498.591072:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591124:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591137:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591154:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591161:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591168:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591668:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591679:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591687:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498498.591735:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591749:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591897:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591904:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591910:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498498.591914:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591922:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591935:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498498.591938:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498498.591944:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591950:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591962:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591968:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591973:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591977:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498498.591987:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.591992:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592000:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea84ebfe00) 00010000:00010000:0.0:1789498498.592003:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498498.592006:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592012:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc187c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592027:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592032:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592038:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592042:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498498.592045:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592051:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592057:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea84ebfb00) 00010000:00010000:0.0:1789498498.592059:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498498.592068:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.592074:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc187ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.592199:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:10460:x1876424864608512:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 1210us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498498.592207:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:1.0:1789498498.653263:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.654171:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864608768 00000100:00100000:3.0:1789498498.654183:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864608768 00000100:00100000:3.0:1789498498.654237:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:3.0:1789498498.654248:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:10463:x1876424864608768:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498498.654270:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498498.654292:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc187d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a103 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654442:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654457:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654468:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654484:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654491:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654497:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654849:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654858:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654866:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498498.654876:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789498498.654974:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654981:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654987:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.654993:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbe00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.654997:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655006:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655018:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498498.655021:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.655027:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655042:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc187d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655057:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655062:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655068:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655074:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.655077:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655082:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655482:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea9108c600) 00010000:00010000:3.0:1789498498.655486:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.655490:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655496:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc187df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655547:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc187d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655560:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.655574:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:3.0:1789498498.655576:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498498.655578:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db000, rc 0) 00000100:00100000:3.0:1789498498.655764:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10463:x1876424864608768:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1517us (2525us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789498498.655773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:2.0:1789498498.663387:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498498.663497:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864608896 00000100:00100000:1.0:1789498498.663507:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864608896 00000100:00100000:1.0:1789498498.663559:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:1.0:1789498498.663566:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10463:x1876424864608896:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:1.0:1789498498.663634:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663646:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663655:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663684:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663690:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663697:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663704:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498498.663709:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663716:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663742:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:1.0:1789498498.663744:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498498.663748:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.663753:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc187f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498498.663827:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10463:x1876424864608896:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 261us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498498.663836:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:1.0:1789498498.665940:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.665982:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864609152 00000100:00100000:2.0:1789498498.665992:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864609152 00000100:00100000:2.0:1789498498.666044:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:2.0:1789498498.666054:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5956450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10463:x1876424864609152:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498498.666422:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5956450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:10463:x1876424864609152:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 369us (487us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789498498.666430:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:2.0:1789498498.689639:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.689736:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864609408 00000100:00100000:0.0:1789498498.689747:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864609408 00000100:00100000:0.0:1789498498.689806:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:0.0:1789498498.689817:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:9992:x1876424864609408:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498498.689842:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498498.689862:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a10a expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.689977:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.689993:0:7250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.690002:0:7250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.690038:0:7250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.690051:0:7250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 23 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.690081:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885604352:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498498.690221:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f27240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498498.693593:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.693670:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864609536 00000100:00100000:3.0:1789498498.693688:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864609536 00010000:00010000:3.0:1789498498.693740:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 24 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498498.693799:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:3.0:1789498498.693809:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2355:x1876424864609536:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498498.693826:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498498.693833:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 24 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.693847:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 24 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.693869:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:3.0:1789498498.693874:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.693883:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.693910:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.693932:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498498.693992:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2355:x1876424864609536:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 184us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.694000:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00010000:00010000:2.0:1789498498.694182:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc187e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a103 expref: 23 pid: 5845 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498498.694201:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885604352:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498498.694226:0:7250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.694234:0:7250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.694240:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498498.694270:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789498498.694431:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc187fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 24 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.694447:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 23 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.694454:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:2.0:1789498498.694457:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498498.694460:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5400, rc 0) 00000100:00100000:2.0:1789498498.694485:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:9992:x1876424864609408:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4671us (4857us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789498498.694498:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:1.0:1789498498.698512:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.698607:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864609792 00000100:00100000:0.0:1789498498.698617:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864609792 00000100:00100000:0.0:1789498498.698703:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:0.0:1789498498.698714:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:9992:x1876424864609792:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:0.0:1789498498.699024:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.699041:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.699052:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498498.699146:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1789498498.699171:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f846078f reply state 000000008721481d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.699179:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789498498.699223:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1789498498.699692:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:9992:x1876424864609792:12345-192.168.201.20@tcp:36:bash.0 Request processed in 979us (1187us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789498498.699701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000020:00080000:0.0:1789498498.699706:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1789498498.701293:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.701309:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.701316:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.701322:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498498.701326:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.701335:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.701356:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:2.0:1789498498.701359:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498498.701365:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.701371:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498498.702007:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.702081:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864609920 00000100:00100000:3.0:1789498498.702121:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864609920 00000100:00100000:3.0:1789498498.702172:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:3.0:1789498498.702181:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:9992:x1876424864609920:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498498.702203:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498498.702222:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18817 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a111 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.702292:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18817 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a111 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.702305:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18817 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a111 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.702324:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:3.0:1789498498.702326:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498498.702329:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db400, rc 0) 00000100:00100000:3.0:1789498498.702383:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:9992:x1876424864609920:12345-192.168.201.20@tcp:101:bash.0 Request processed in 203us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498498.702390:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:1.0:1789498498.705052:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498498.705306:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864610048 00000100:00100000:0.0:1789498498.705317:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864610048 00000100:00100000:1.0:1789498498.705473:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:1.0:1789498498.705482:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:9992:x1876424864610048:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498498.705498:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498498.705519:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a118 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498498.705546:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa99480, atime: 0x6aa9947f, ctime: 0x6aa99480, blocks: 0xb 00010000:00010000:1.0:1789498498.705565:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1789498498.705569:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498498.705576:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.705652:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498498.705716:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde400, rc 0) 00000100:00100000:1.0:1789498498.705817:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:9992:x1876424864610048:12345-192.168.201.20@tcp:101:bash.0 Request processed in 334us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498498.705824:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:1.0:1789498498.707916:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.710360:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864610176 00000100:00100000:3.0:1789498498.710384:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864610176 00002000:00010000:2.0:1789498498.710946:0:6707:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1789498498.710954:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabafaf100 with x1876424864610176 ext(0->18446744073709551615) 00002000:00010000:2.0:1789498498.710966:0:6707:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eabafaf100. 00000100:00100000:2.0:1789498498.711066:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:2.0:1789498498.711078:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864610176:12345-192.168.201.20@tcp:10:bash.0 00002000:00010000:2.0:1789498498.711485:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789498498.711490:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789498496 -> 1789498498 00002000:00010000:2.0:1789498498.711493:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789498495 -> 1789498495 00002000:00010000:2.0:1789498498.711495:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789498496 -> 1789498498 00002000:00010000:2.0:1789498498.711497:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789498498.711637:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864610176:12345-192.168.201.20@tcp:10:bash.0 Request processed in 560us (3728us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789498498.711646:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00002000:00010000:2.0:1789498498.711650:0:6707:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1789498498.711653:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabafaf100 with x1876424864610176 ext(0->18446744073709551615) 00002000:00010000:2.0:1789498498.711658:0:6707:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eabafaf100. 00000100:00100000:3.0:1789498498.816378:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.817816:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864610304 00000100:00100000:2.0:1789498498.817830:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864610304 00000100:00100000:2.0:1789498498.817915:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:2.0:1789498498.817926:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:10477:x1876424864610304:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:2.0:1789498498.818002:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818018:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818028:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818044:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818051:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818073:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818348:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818359:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818367:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498498.818414:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818426:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818432:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818440:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818445:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498498.818450:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818458:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818470:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498498.818479:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498498.818485:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818492:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18825 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818506:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818513:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818519:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818524:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498498.818527:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818534:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818542:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98eaa1d46100) 00010000:00010000:2.0:1789498498.818545:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498498.818548:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818554:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc1882c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818567:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818579:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818586:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818591:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498498.818594:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818601:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818609:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:2.0:1789498498.818612:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498498.818615:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.818621:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498498.818716:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:10477:x1876424864610304:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 791us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.818725:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:1.0:1789498498.872282:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.872463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864610560 00000100:00100000:3.0:1789498498.872474:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864610560 00000100:00100000:3.0:1789498498.872535:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:3.0:1789498498.872546:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:10480:x1876424864610560:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498498.872568:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498498.872598:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1883a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a11f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.872770:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.872786:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.872797:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.872813:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.872820:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.872827:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873142:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1884f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873162:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1884f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873170:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1884f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498498.873181:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789498498.873368:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873376:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873382:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873388:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbe00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.873392:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873399:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873411:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498498.873414:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.873418:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873424:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873437:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873449:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873454:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873460:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498498.873463:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873469:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873478:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea9108c600) 00010000:00010000:3.0:1789498498.873481:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498498.873483:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873489:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873533:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1883a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a11f expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873547:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1884f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a11f expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498498.873554:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:3.0:1789498498.873556:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789498498.873564:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbc00, rc 0) 00000100:00100000:3.0:1789498498.873818:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:10480:x1876424864610560:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1273us (1543us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789498498.873827:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:1.0:1789498498.879006:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.879220:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864610688 00000100:00100000:2.0:1789498498.879230:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864610688 00000100:00100000:2.0:1789498498.879288:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:2.0:1789498498.879299:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:10480:x1876424864610688:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:2.0:1789498498.879371:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.879404:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 29 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.879414:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.879451:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 29 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.879464:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 29 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498498.879479:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885604480:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498498.879571:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9106d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789498498.882558:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.882699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864610944 00000100:00100000:3.0:1789498498.882708:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864610944 00000100:00100000:3.0:1789498498.882771:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:3.0:1789498498.882781:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:5598:x1876424864610944:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789498498.883180:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:5598:x1876424864610944:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 399us (630us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789498498.883188:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1789498498.883945:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885604480:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498498.883974:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498498.886027:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.886133:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864611072 00000100:00100000:2.0:1789498498.886143:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864611072 00010000:00010000:2.0:1789498498.886181:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 31 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498498.886221:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:2.0:1789498498.886231:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:2355:x1876424864611072:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498498.886249:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498498.886270:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 31 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.886283:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 31 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.886305:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18802 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a10a expref: 31 pid: 7250 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.886319:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:2.0:1789498498.886323:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.886332:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.886340:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.886376:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498498.886433:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:2355:x1876424864611072:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 203us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498498.886441:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00010000:00010000:0.0:1789498498.886498:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.886506:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.886544:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.886552:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.886560:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.886565:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498498.886569:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.886575:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.886591:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:0.0:1789498498.886593:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789498498.886595:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498498.886599:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1885d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498498.886632:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:10480:x1876424864610688:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 7337us (7638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498498.886637:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:1.0:1789498498.888784:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.888895:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864611328 00000100:00100000:3.0:1789498498.888904:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864611328 00000100:00100000:3.0:1789498498.888952:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1789498498.888961:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:10480:x1876424864611328:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498498.889202:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:10480:x1876424864611328:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 242us (425us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789498498.889207:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:1.0:1789498498.964543:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498498.964602:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864611584 00000100:00100000:2.0:1789498498.964613:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864611584 00000100:00100000:2.0:1789498498.964671:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:2.0:1789498498.964681:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:10491:x1876424864611584:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:2.0:1789498498.964704:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498498.964725:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a126 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965234:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965250:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965395:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965413:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965421:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965428:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965750:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965760:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965768:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498498.965835:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789498498.965936:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965944:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965957:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965963:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498498.965967:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965975:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.965987:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498498.965991:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498498.965996:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966002:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc1886b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966016:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966022:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966028:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966034:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498498.966037:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966052:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966059:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98eaa1d46100) 00010000:00010000:2.0:1789498498.966061:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498498.966064:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966070:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966229:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a126 expref: 33 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966245:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a126 expref: 32 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498498.966252:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:2.0:1789498498.966265:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498498.966268:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24000, rc 0) 00000100:00100000:2.0:1789498498.966334:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:10491:x1876424864611584:12345-192.168.201.20@tcp:101:cat.0 Request processed in 1654us (1797us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789498498.966342:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:1.0:1789498498.974909:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498498.975016:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864611840 00000100:00100000:3.0:1789498498.975026:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864611840 00000100:00100000:3.0:1789498498.975080:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:3.0:1789498498.975121:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:10491:x1876424864611840:12345-192.168.201.20@tcp:35:cat.0 00000100:00100000:3.0:1789498498.975369:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:10491:x1876424864611840:12345-192.168.201.20@tcp:35:cat.0 Request processed in 280us (469us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789498498.975377:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00010000:00010000:3.0:1789498498.987883:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498499.000997:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.001496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864612096 00000100:00100000:2.0:1789498499.001507:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864612096 00000100:00100000:2.0:1789498499.001572:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:2.0:1789498499.001583:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:10492:x1876424864612096:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1789498499.001670:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789498499.001701:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a126 expref: 33 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.001725:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc1884f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a11f expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.001738:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18817 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a111 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.001747:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98ea9108c800) 00010000:00010000:2.0:1789498499.001880:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498499.001900:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.001914:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.001924:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.001938:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.001944:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.001951:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.002562:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.002573:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.002581:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498499.003548:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:2.0:1789498499.003641:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.003656:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.003667:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.003674:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.003681:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.003687:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.003718:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498499.003744:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.003751:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498499.003761:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.003857:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.003863:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.005367:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498499.005377:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.005391:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.005406:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:3.0:1789498499.005410:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789498499.005414:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.005420:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1889c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.005442:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498499.005443:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498499.005445:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498499.005487:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498499.005494:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005501:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005510:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:2.0:1789498499.005512:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789498499.005515:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005522:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18895 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005558:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005566:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005573:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005578:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498499.005734:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005741:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005749:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498499.005752:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498499.005833:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.005840:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498499.005853:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e85b496 reply state 00000000189d9357 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.005862:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498499.006054:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:10492:x1876424864612096:12345-192.168.201.20@tcp:36:rm.0 Request processed in 4468us (5063us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789498499.006063:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00010000:00010000:2.0:1789498499.008781:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.008800:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.008808:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.008815:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498499.008820:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.008840:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.008856:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98eaa1d46100) 00010000:00010000:2.0:1789498499.008859:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498499.008863:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.008871:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc1888e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.051538:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498499.051559:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885604736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498499.051633:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498499.051718:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885604736 00000100:00100000:0.0:1789498499.051727:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885604736 00000100:00100000:1.0:1789498499.051803:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885604608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498499.051836:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498499.052973:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885604608 00000100:00100000:0.0:1789498499.052982:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885604608 00000100:00100000:0.0:1789498499.053015:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789498499.053023:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876424885604736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498499.053060:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498499.053152:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876424885604736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498499.053160:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498499.053528:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885604736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498499.053633:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498499.053665:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864612352 00000100:00100000:1.0:1789498499.053669:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864612352 00000100:00100000:1.0:1789498499.053701:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:1.0:1789498499.053709:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:10498:x1876424864612352:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498499.053739:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498499.053761:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc188a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a12d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.053879:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.053896:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.053908:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.053925:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.053932:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.053939:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789498499.055704:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789498499.055912:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.055927:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.055939:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056806:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056817:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056824:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056831:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498499.056835:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056843:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056856:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:1.0:1789498499.056859:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498499.056864:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056869:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc188aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498499.056884:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008005d870 reply state 00000000ec1c1d98 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498499.056893:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498499.056901:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789498499.056921:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885604608:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789498499.056930:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc188a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056960:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.056967:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98ea930e1c00) 00010000:00010000:1.0:1789498499.056969:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498499.056972:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddec00, rc 0) 00000100:00100000:1.0:1789498499.057038:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:10498:x1876424864612352:12345-192.168.201.20@tcp:101:bash.0 Request processed in 3329us (3406us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789498499.057045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00002000:00000024:3.0:1789498499.061439:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789498499.061537:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885604608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4620us (9696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498499.061549:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498499.061630:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885604608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789498499.064970:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.064991:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.065000:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.065007:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498499.065013:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.065021:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.065037:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea930e1b00) 00010000:00010000:2.0:1789498499.065040:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498499.065046:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.065068:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc188b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.065377:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498499.065516:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864612480 00000100:00100000:1.0:1789498499.065528:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864612480 00000100:00100000:1.0:1789498499.065641:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:1.0:1789498499.065652:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864612480:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498499.065676:0:10445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498499.065708:0:10445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a134 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498499.065736:0:10445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498499.065754:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1789498499.065759:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498499.065768:0:10445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 8 pid: 10445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.065785:0:10445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 8 pid: 10445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.065805:0:10445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddee00, rc 0) 00000100:00100000:1.0:1789498499.065870:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864612480:12345-192.168.201.20@tcp:101:bash.0 Request processed in 220us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498499.065877:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00080000:2.0:1789498499.067610:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498499.069442:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.069549:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864612608 00000100:00100000:2.0:1789498499.069559:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864612608 00000100:00100000:2.0:1789498499.069623:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:2.0:1789498499.069633:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:10498:x1876424864612608:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498499.069651:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498499.069669:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a13b expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.069918:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 9 pid: 10445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.069929:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498499.069933:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498499.070174:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.070211:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 9 pid: 10445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.070223:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 9 pid: 10445 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.070256:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1876424885604864:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498499.070333:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87d7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789498499.073371:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.073468:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1876424885604864:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498499.073499:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.073520:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25200, rc 0) 00000100:00100000:2.0:1789498499.073579:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:10498:x1876424864612608:12345-192.168.201.20@tcp:101:bash.0 Request processed in 3948us (4146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.073596:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:1.0:1789498499.073874:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864612736 00000100:00100000:1.0:1789498499.073882:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864612736 00010000:00010000:1.0:1789498499.073913:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 9 pid: 10445 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498499.073948:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:1.0:1789498499.073958:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85661450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2356:x1876424864612736:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498499.073971:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498499.073995:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 9 pid: 10445 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.074009:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 9 pid: 10445 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.074032:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f1e5c1f/0x3a6cb1946bc188c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a134 expref: 9 pid: 10445 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.074047:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498499.074052:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498499.074060:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.074084:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498499.074160:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498499.074175:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1876424885604992:192.168.201.20@tcp:105: 00000100:00100000:1.0:1789498499.074229:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498499.078002:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1876424885604992:192.168.201.20@tcp:105: 00010000:00010000:1.0:1789498499.078029:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498499.078119:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85661450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864612736:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 4161us (4758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498499.078131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:3.0:1789498499.081559:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.081903:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864612992 00000100:00100000:0.0:1789498499.081915:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864612992 00000100:00100000:0.0:1789498499.081971:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1789498499.081982:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:10498:x1876424864612992:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:0.0:1789498499.082819:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:10498:x1876424864612992:12345-192.168.201.20@tcp:35:bash.0 Request processed in 835us (1267us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789498499.082829:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1789498499.281438:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.281618:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864613120 00000100:00100000:2.0:1789498499.281629:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864613120 00000100:00100000:2.0:1789498499.281703:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:2.0:1789498499.281715:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:10514:x1876424864613120:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498499.281742:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498499.281774:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc188d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.281848:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc188db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.281863:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc188db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.281878:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc188db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498499.281937:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789498499.281947:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498499.281967:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc188db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.281994:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc188d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a142 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.282013:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc188db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a142 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.282022:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498499.282026:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498499.282030:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25c00, rc 0) 00000100:00100000:2.0:1789498499.282154:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:10514:x1876424864613120:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 442us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.282162:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:1.0:1789498499.295432:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498499.295558:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864613376 00000100:00100000:3.0:1789498499.295645:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864613376 00000100:00100000:3.0:1789498499.295910:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:3.0:1789498499.295923:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:10514:x1876424864613376:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498499.296004:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498499.296030:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc188e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a149 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.296192:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc188e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.296208:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc188e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.296221:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc188e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498499.296306:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789498499.296446:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc188e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a149 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.296466:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc188e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a149 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.296474:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98ea930e1c00) 00010000:00010000:3.0:1789498499.296477:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498499.296481:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20da800, rc 0) 00000100:00100000:3.0:1789498499.296676:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:10514:x1876424864613376:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 755us (1253us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789498499.296684:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:3.0:1789498499.304825:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498499.304927:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.305183:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864613760 00000100:00100000:0.0:1789498499.305194:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864613760 00000100:00100000:0.0:1789498499.305262:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:0.0:1789498499.305273:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:2355:x1876424864613760:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498499.305309:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498499.305336:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc188e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a149 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.305356:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98ea930e1c00) 00010000:00010000:0.0:1789498499.305361:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498499.305415:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+36:2355:x1876424864613760:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 143us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498499.305422:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1789498499.309107:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864613632 00000100:00100000:2.0:1789498499.309123:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864613632 00000100:00100000:2.0:1789498499.309199:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:2.0:1789498499.309210:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+36:10514:x1876424864613632:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498499.309247:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498499.309568:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc188f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a150 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.309884:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc188fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.309919:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc188fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.309930:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc188fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498499.310058:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789498499.310366:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc188f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a150 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.310392:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc188fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a150 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.310401:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98ea930e1c00) 00010000:00010000:2.0:1789498499.310404:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789498499.310408:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24000, rc 0) 00000100:00100000:2.0:1789498499.310488:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:10514:x1876424864613632:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1279us (5673us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789498499.310496:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:1.0:1789498499.317538:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.317655:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864613888 00000100:00100000:2.0:1789498499.317674:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864613888 00000100:00100000:2.0:1789498499.317739:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:2.0:1789498499.317760:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864613888:12345-192.168.201.20@tcp:1:lfs.0 00010000:00010000:2.0:1789498499.317807:0:10445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.317830:0:10445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.317852:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789498499.317857:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498499.317862:0:10445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.317898:0:10445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.317913:0:10445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 8 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.317928:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10445:1876424885605120:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498499.318021:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea81254000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498499.321543:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10445:1876424885605120:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498499.321588:0:10445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498499.325510:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.325606:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864614016 00000100:00100000:0.0:1789498499.325618:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864614016 00002000:00100000:0.0:1789498499.325685:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98eabaaad180 x1876424864614016/t0(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:530/0 lens 504/0 e 0 to 0 dl 1789498510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789498499.325698:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabaaad180 with x1876424864614016 ext(0->8) 00010000:00010000:0.0:1789498499.325708:0:6709:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 9 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.325726:0:6709:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 9 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789498499.325734:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98eabaaad180 00000100:00100000:0.0:1789498499.325777:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:0.0:1789498499.325788:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2356:x1876424864614016:12345-192.168.201.20@tcp:4:lfs.0 00000100:00100000:0.0:1789498499.326346:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:2356:x1876424864614016:12345-192.168.201.20@tcp:4:lfs.0 Request processed in 559us (845us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789498499.326363:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00002000:00100000:0.0:1789498499.326371:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98eabaaad180 x1876424864614016/t4294967302(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:530/0 lens 504/448 e 0 to 0 dl 1789498510 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789498499.326380:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabaaad180 with x1876424864614016 ext(0->8) 00010000:00010000:0.0:1789498499.326386:0:6709:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 11 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.326399:0:6709:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 11 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789498499.326406:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98eabaaad180 00000100:00100000:1.0:1789498499.331446:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.331543:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864614144 00000100:00100000:0.0:1789498499.331554:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864614144 00010000:00010000:0.0:1789498499.331605:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 11 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.331650:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:0.0:1789498499.331669:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:2355:x1876424864614144:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498499.331686:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789498499.331711:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789498499.331715:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789498498 00002000:00010000:0.0:1789498499.331717:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789498498 00002000:00010000:0.0:1789498499.331719:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789498498 00010000:00010000:0.0:1789498499.331724:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 11 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.331765:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 11 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.331792:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bebf9c6b/0x3a6cb1946bc188cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a13b expref: 11 pid: 6702 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.331812:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498499.331817:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498499.331822:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.331832:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.331867:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498499.331929:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2355:x1876424864614144:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 270us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498499.331937:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00010000:00010000:2.0:1789498499.332007:0:10445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.332017:0:10445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.332040:0:10445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.332053:0:10445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.332061:0:10445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.332067:0:10445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498499.332071:0:10445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.332079:0:10445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.332141:0:10445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.332149:0:10445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067f051df/0x3a6cb1946bc1890c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.332191:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2356:x1876424864613888:12345-192.168.201.20@tcp:1:lfs.0 Request processed in 14435us (14663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.332198:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:1.0:1789498499.336014:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498499.336397:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864614400 00000100:00100000:3.0:1789498499.336408:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864614400 00000100:00100000:3.0:1789498499.336474:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:3.0:1789498499.336484:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5957050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:10514:x1876424864614400:12345-192.168.201.20@tcp:35:lfs.0 00000004:00010000:3.0:1789498499.336547:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc188fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a150 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498499.336862:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1789498499.336917:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1789498499.339516:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1789498499.339831:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.339854:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.339863:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.339906:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.339925:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 42 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498499.339940:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876424885605248:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498499.340318:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba480 going to sleep for 11 seconds 00000100:00100000:1.0:1789498499.345517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498499.346072:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876424885605248:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498499.346132:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.346323:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864614528 00000100:00100000:2.0:1789498499.346333:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864614528 00010000:00010000:2.0:1789498499.346389:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 43 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.346496:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:2.0:1789498499.346507:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:2355:x1876424864614528:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498499.346523:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498499.346531:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 43 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.346544:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 43 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.346571:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc188b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a12d expref: 43 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.346665:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98ea930e1c00) 00010000:00010000:2.0:1789498499.346671:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.346682:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.346690:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.346719:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498499.346894:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+42:2355:x1876424864614528:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 388us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.346902:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00010000:00010000:3.0:1789498499.347037:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.347046:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498499.347221:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789498499.347446:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1789498499.347565:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876424885605376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789498499.347634:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498499.347683:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498499.348059:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885605376 00000100:00100000:0.0:1789498499.348067:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885605376 00000100:00100000:0.0:1789498499.348138:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789498499.348149:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1876424885605376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789498499.348229:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1876424885605376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498499.348236:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498499.348417:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876424885605376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789498499.349247:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789498499.349320:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876424885605504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789498499.349369:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498499.349395:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498499.349465:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885605504 00000100:00100000:0.0:1789498499.349471:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885605504 00000100:00100000:0.0:1789498499.349512:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789498499.349521:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1876424885605504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789498499.349918:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5848:x1876424885605504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 398us (549us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789498499.349926:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498499.351497:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876424885605504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789498499.351736:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1789498499.351875:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.351888:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.351895:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.351916:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbe00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498499.351921:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.351930:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.351945:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98ea930e1c00) 00010000:00010000:3.0:1789498499.351948:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789498499.351954:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.351960:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18913 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789498499.352304:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789498499.352409:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789498499.352421:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399116330115ns, next at 400116328060ns, rc = 0 00000001:00080000:3.0:1789498499.352428:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789498499.352465:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98ea930e1c00) 00010000:00010000:3.0:1789498499.352468:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789498499.352476:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc188fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a150 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498499.352922:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5957050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:10514:x1876424864614400:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 16438us (16915us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789498499.352932:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000020:00080000:3.0:1789498499.352938:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789498499.356055:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.356397:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864614656 00000100:00100000:2.0:1789498499.356426:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864614656 00000100:00100000:2.0:1789498499.356527:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:2.0:1789498499.356540:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:10514:x1876424864614656:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498499.356570:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498499.356610:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1891a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a157 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.356701:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1891a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a157 expref: 46 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.356717:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1891a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a157 expref: 46 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.356757:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498499.356762:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498499.356765:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24600, rc 0) 00000100:00100000:2.0:1789498499.356831:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+46:10514:x1876424864614656:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 294us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.356839:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:1.0:1789498499.360635:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.360938:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864614912 00000100:00100000:0.0:1789498499.360948:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864614912 00000100:00100000:0.0:1789498499.361029:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1789498499.361039:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+46:10514:x1876424864614912:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1789498499.361310:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10514:x1876424864614912:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 272us (685us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789498499.361318:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:1.0:1789498499.468402:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.468503:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864615040 00000100:00100000:0.0:1789498499.468514:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864615040 00000100:00100000:0.0:1789498499.468586:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:0.0:1789498499.468596:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10524:x1876424864615040:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:0.0:1789498499.468681:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.468699:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.468712:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.468726:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.468959:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.468967:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469060:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469068:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469076:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498499.469170:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469185:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469190:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469197:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469203:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498499.469207:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469214:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469234:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498499.469237:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498499.469243:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469249:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18921 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469262:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469267:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469272:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469278:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498499.469280:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469287:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469293:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea84ebfb00) 00010000:00010000:0.0:1789498499.469295:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498499.469299:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469304:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469330:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469336:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469341:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469345:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498499.469348:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469354:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469360:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:0.0:1789498499.469362:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498499.469365:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.469371:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc1892f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.469444:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10524:x1876424864615040:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 847us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498499.469452:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:1.0:1789498499.515433:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498499.515584:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864615296 00000100:00100000:3.0:1789498499.515594:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864615296 00000100:00100000:3.0:1789498499.515659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:3.0:1789498499.515669:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:10528:x1876424864615296:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498499.515689:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498499.515711:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18936 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a15e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.515980:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.515995:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516007:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516022:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516029:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516035:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516200:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516209:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516226:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498499.516236:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789498499.516522:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516531:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516538:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516543:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498499.516548:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516555:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516566:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498499.516624:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498499.516629:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516636:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc1893d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516659:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516666:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516678:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516683:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498499.516686:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516693:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516700:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea9108c600) 00010000:00010000:3.0:1789498499.516702:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498499.516705:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516711:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516866:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18936 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516882:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.516890:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:3.0:1789498499.516892:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498499.516894:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db400, rc 0) 00000100:00100000:3.0:1789498499.517017:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+49:10528:x1876424864615296:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1349us (1592us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789498499.517032:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:1.0:1789498499.520961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.521061:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864615424 00000100:00100000:2.0:1789498499.521071:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864615424 00000100:00100000:2.0:1789498499.521152:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:2.0:1789498499.521161:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+49:10528:x1876424864615424:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:2.0:1789498499.521226:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521244:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521472:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521502:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521509:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521516:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521522:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498499.521526:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521533:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521543:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498499.521546:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498499.521550:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.521556:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.521628:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+49:10528:x1876424864615424:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 468us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.521636:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:1.0:1789498499.524035:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498499.524419:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864615680 00000100:00100000:3.0:1789498499.524430:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864615680 00000100:00100000:3.0:1789498499.524474:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1789498499.524485:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+49:10528:x1876424864615680:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498499.524763:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10528:x1876424864615680:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 278us (735us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789498499.524771:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:1.0:1789498499.570406:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.570562:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864615936 00000100:00100000:2.0:1789498499.570584:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864615936 00000100:00100000:2.0:1789498499.570646:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:2.0:1789498499.570655:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10538:x1876424864615936:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498499.570683:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498499.570687:0:7250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789498499.570716:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc188db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a142 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.570734:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498499.570737:0:7250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498499.570750:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18960 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a165 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.570850:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.570865:0:7250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.570874:0:7250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.570906:0:7250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.570920:0:7250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 50 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.570933:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885605632:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498499.571043:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea81254780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498499.573491:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.573492:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885605632:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498499.573522:0:7250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498499.573578:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864616064 00000100:00100000:3.0:1789498499.573586:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864616064 00010000:00010000:3.0:1789498499.573624:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 51 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498499.573665:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:3.0:1789498499.573676:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+51:2355:x1876424864616064:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498499.573690:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498499.573698:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 51 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.573707:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 51 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.573723:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1894b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a15e expref: 51 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.573736:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:3.0:1789498499.573753:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.573763:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.573771:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.573801:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498499.573854:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:2355:x1876424864616064:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 179us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498499.573861:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00010000:00010000:2.0:1789498499.573911:0:7250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.573918:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498499.573935:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789498499.574121:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18960 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 51 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.574137:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 50 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.574144:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498499.574147:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498499.574149:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25800, rc 0) 00000100:00100000:2.0:1789498499.574173:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10538:x1876424864615936:12345-192.168.201.20@tcp:101:bash.0 Request processed in 3520us (3779us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789498499.574180:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:1.0:1789498499.577368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.577669:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864616320 00000100:00100000:0.0:1789498499.577679:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864616320 00000100:00100000:0.0:1789498499.577747:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:0.0:1789498499.577773:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:10538:x1876424864616320:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:0.0:1789498499.579042:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.579060:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.579068:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498499.579162:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1789498499.579192:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000893c69d reply state 0000000088bd303f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.579199:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498499.579295:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10538:x1876424864616320:12345-192.168.201.20@tcp:36:bash.0 Request processed in 1523us (1935us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789498499.579302:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 105 00000020:00080000:0.0:1789498499.579308:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498499.582642:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498499.582645:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:2.0:1789498499.582657:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.582685:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.582691:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498499.582696:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.582704:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.582721:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498499.582725:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498499.582730:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.582736:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18975 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498499.582764:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864616448 00000100:00100000:3.0:1789498499.582774:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864616448 00000100:00100000:3.0:1789498499.582830:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:3.0:1789498499.582840:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10538:x1876424864616448:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498499.582863:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498499.582974:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1897c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a16c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.583044:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.583054:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 53 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.583060:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.583129:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 53 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.583143:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 53 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498499.583155:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885605760:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498499.583225:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498499.586617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.586717:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864616576 00000100:00100000:2.0:1789498499.586726:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864616576 00000100:00100000:3.0:1789498499.586755:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885605760:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498499.586783:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.586888:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 54 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.586927:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1789498499.586937:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:2355:x1876424864616576:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498499.586952:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498499.586959:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 54 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.586987:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 54 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.587008:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc18967 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a165 expref: 54 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.587023:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498499.587028:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.587037:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.587044:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.587070:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498499.587115:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.587122:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.587163:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:2355:x1876424864616576:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 227us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.587170:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000004:00200000:3.0:1789498499.587173:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789498499.587177:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498499.587199:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.587233:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc1897c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.587250:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.587270:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:3.0:1789498499.587272:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498499.587275:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498499.587301:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10538:x1876424864616448:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4463us (4665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498499.587307:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:2.0:1789498499.592968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498499.593126:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864616832 00000100:00100000:3.0:1789498499.593138:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864616832 00000100:00100000:3.0:1789498499.593188:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1789498499.593199:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:10538:x1876424864616832:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:3.0:1789498499.593452:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10538:x1876424864616832:12345-192.168.201.20@tcp:35:bash.0 Request processed in 245us (484us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789498499.593460:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:1.0:1789498499.664448:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.664560:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864616960 00000100:00100000:2.0:1789498499.664636:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864616960 00000100:00100000:2.0:1789498499.664825:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:2.0:1789498499.664836:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+53:10544:x1876424864616960:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498499.664861:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498499.664882:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1898a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a173 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.664978:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18991 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.664994:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.665005:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498499.665047:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789498499.665051:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498499.665070:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.665149:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc1898a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a173 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.665170:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a173 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.665178:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498499.665181:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498499.665185:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24e00, rc 0) 00000100:00100000:2.0:1789498499.665251:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10544:x1876424864616960:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 417us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.665729:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:1.0:1789498499.668963:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498499.672039:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864617088 00000100:00100000:3.0:1789498499.672056:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864617088 00000100:00100000:3.0:1789498499.672158:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 108 00000100:00100000:3.0:1789498499.672168:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10544:x1876424864617088:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498499.672186:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498499.672203:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18998 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a17a expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672258:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672274:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672301:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672317:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672324:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672330:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672426:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672435:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672549:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498499.672589:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789498499.672593:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498499.672613:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672625:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672633:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672645:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672650:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672656:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498499.672660:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672668:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672679:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:3.0:1789498499.672682:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498499.672687:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672693:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc1899f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672707:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672711:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672714:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672717:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498499.672723:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672728:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672733:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea9108c600) 00010000:00010000:3.0:1789498499.672734:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498499.672736:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672742:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc189a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672903:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18998 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 56 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672914:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 55 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498499.672920:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:3.0:1789498499.672921:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498499.672923:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbc00, rc 0) 00000100:00100000:3.0:1789498499.673008:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10544:x1876424864617088:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 842us (4053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498499.673013:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 108 00000100:00100000:1.0:1789498499.681614:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.681699:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864617344 00000100:00100000:0.0:1789498499.681709:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864617344 00000100:00100000:0.0:1789498499.681954:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:0.0:1789498499.681966:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10544:x1876424864617344:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498499.681989:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498499.682010:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a181 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.682163:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.682199:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.682208:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 56 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.682215:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.682249:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 56 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.682263:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 56 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.682277:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885605888:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498499.682368:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.682378:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 56 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.682414:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885606016:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498499.682441:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f27240 going to sleep for 11 seconds 00000100:00100000:3.0:1789498499.683042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.683595:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864617472 00000100:00100000:0.0:1789498499.683604:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864617472 00010000:00010000:0.0:1789498499.683646:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 57 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.683685:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:0.0:1789498499.683694:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:2355:x1876424864617472:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498499.683708:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498499.683714:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 57 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.683728:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 57 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.683750:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:0.0:1789498499.683774:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.683784:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.683790:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498499.683836:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:2355:x1876424864617472:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 143us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498499.683842:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 54 00010000:00010000:0.0:1789498499.687019:0:5846:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.20@tcp) returned -22 from blocking AST (req@00000000b1a409ea x1876424885605888) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 56 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.687046:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc189ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a17a expref: 56 pid: 7250 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498499.687117:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885605888:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498499.688577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.688998:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885606016:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498499.689026:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:0.0:1789498499.689033:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.689044:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.689055:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.689924:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864617600 00000100:00100000:2.0:1789498499.689935:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864617600 00010000:00010000:2.0:1789498499.689990:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 56 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498499.690027:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:2.0:1789498499.690037:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85663850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:2357:x1876424864617600:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498499.690054:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498499.690061:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 56 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.690073:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 56 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.690147:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a16c expref: 56 pid: 5845 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.690167:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498499.690172:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.690180:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.690188:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.690298:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498499.690363:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85663850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:2357:x1876424864617600:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 326us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.690371:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 55 00010000:00010000:0.0:1789498499.690750:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.690951:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498499.690974:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789498499.691309:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.691328:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.691336:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:0.0:1789498499.691339:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789498499.691351:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5e00, rc 0) 00000100:00100000:0.0:1789498499.691435:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10544:x1876424864617344:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 9471us (9830us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789498499.691505:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:3.0:1789498499.693900:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.694803:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864617856 00000100:00100000:0.0:1789498499.694813:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864617856 00000100:00100000:0.0:1789498499.695026:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498499.695037:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10544:x1876424864617856:12345-192.168.201.20@tcp:103:lfs.0 00010000:00010000:0.0:1789498499.695053:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498499.695076:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc1891a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a157 expref: 55 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.695131:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:0.0:1789498499.695136:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498499.695188:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10544:x1876424864617856:12345-192.168.201.20@tcp:103:lfs.0 Request processed in 153us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498499.695194:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1789498499.704664:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498499.704818:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864617984 00000100:00100000:0.0:1789498499.704828:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864617984 00000100:00100000:0.0:1789498499.705002:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 110 00000100:00100000:0.0:1789498499.705013:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10544:x1876424864617984:12345-192.168.201.20@tcp:58:lfs.0 00010000:00010000:0.0:1789498499.705153:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.705172:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498499.705185:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498499.705425:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789498499.705514:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10544:x1876424864617984:12345-192.168.201.20@tcp:58:lfs.0 Request processed in 502us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498499.705522:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 110 00000100:00100000:1.0:1789498499.710528:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498499.710692:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864618112 00000100:00100000:2.0:1789498499.710702:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864618112 00000100:00100000:2.0:1789498499.710781:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 111 00000100:00100000:2.0:1789498499.710792:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:10544:x1876424864618112:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498499.710815:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498499.710835:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a188 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.710899:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.710911:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a188 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.710942:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.710957:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a188 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.710969:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498499.710972:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498499.710977:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a188 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498499.710984:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25800, rc 0) 00000100:00100000:2.0:1789498499.711047:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10544:x1876424864618112:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 257us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498499.711053:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 111 00010000:00010000:3.0:1789498500.011257:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498500.396258:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498500.396268:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498500.396309:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789498500.396317:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789498500.396452:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885606144:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789498500.396586:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f27240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498500.400419:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885606144:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789498500.405661:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498500.405890:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864618240 00000100:00100000:3.0:1789498500.405901:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864618240 00000100:00080000:2.0:1789498500.406131:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498500.406379:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 112 00000100:00100000:3.0:1789498500.406391:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10545:x1876424864618240:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498500.406422:0:7250:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498500.406539:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10545:x1876424864618240:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 149us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498500.406547:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 112 00000100:00100000:1.0:1789498500.413847:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.414053:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864618368 00000100:00100000:2.0:1789498500.414063:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864618368 00000100:00100000:2.0:1789498500.414176:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 113 00000100:00100000:2.0:1789498500.414189:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10545:x1876424864618368:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789498500.414284:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414301:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414315:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414350:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414359:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414366:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414389:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414396:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414402:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498500.414447:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789498500.414466:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498500.414480:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414491:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414498:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414507:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414513:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498500.414518:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414526:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414540:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:2.0:1789498500.414543:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498500.414548:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414730:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc189d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414748:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414753:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414769:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414774:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498500.414777:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414783:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414791:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff98eaa1d46200) 00010000:00010000:2.0:1789498500.414794:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498500.414797:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414802:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc189de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414818:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414823:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414828:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414842:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498500.414845:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414860:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414867:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498500.414869:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498500.414872:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.414878:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc189e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.415418:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10545:x1876424864618368:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 Request processed in 1228us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498500.415428:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 113 00000100:00100000:3.0:1789498500.421366:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498500.421450:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864618624 00000100:00100000:0.0:1789498500.421462:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864618624 00000100:00100000:0.0:1789498500.421520:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:0.0:1789498500.421532:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:10545:x1876424864618624:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498500.421563:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498500.421584:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc189ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a18f expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421698:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421714:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421727:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498500.421754:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789498500.421876:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421884:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421890:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421897:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498500.421901:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421909:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421920:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:0.0:1789498500.421923:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789498500.421929:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421946:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc189f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.421989:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc189ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a18f expref: 57 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.422000:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:0.0:1789498500.422002:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789498500.422013:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc189ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a18f expref: 57 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.422023:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5c00, rc 0) 00000100:00100000:0.0:1789498500.422127:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10545:x1876424864618624:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 597us (770us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789498500.422135:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:3.0:1789498500.437122:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.437227:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864618752 00000100:00100000:2.0:1789498500.437237:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864618752 00000100:00100000:2.0:1789498500.437308:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 115 00000100:00100000:2.0:1789498500.437319:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10545:x1876424864618752:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789498500.437357:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789498500.437480:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10545:x1876424864618752:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 162us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498500.437487:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 115 00000100:00100000:1.0:1789498500.441790:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498500.441958:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864619008 00000100:00100000:0.0:1789498500.441968:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864619008 00000100:00100000:0.0:1789498500.442029:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:0.0:1789498500.442039:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10545:x1876424864619008:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498500.442079:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498500.442083:0:7250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789498500.442153:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a173 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.442174:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498500.442178:0:7250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498500.442192:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18a01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a196 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789498500.442744:0:7250:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789498500.443009:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.443023:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.443034:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.443166:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18a01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a196 expref: 58 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.443182:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a196 expref: 57 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.443190:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfb00) 00010000:00010000:0.0:1789498500.443192:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789498500.443195:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5200, rc 0) 00000100:00100000:0.0:1789498500.443284:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:10545:x1876424864619008:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1246us (1504us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789498500.443293:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1789498500.450427:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.457859:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864619264 00000100:00100000:2.0:1789498500.457878:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864619264 00000100:00100000:2.0:1789498500.458235:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:2.0:1789498500.458247:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:10545:x1876424864619264:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789498500.458310:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498500.458354:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc18a08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a196 expref: 57 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458377:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfb00) 00010000:00010000:2.0:1789498500.458389:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498500.458413:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458441:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458452:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458468:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458474:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458481:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458553:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458562:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458568:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458574:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498500.458586:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458594:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458602:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498500.458605:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498500.458609:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458616:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458627:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458633:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458639:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458644:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498500.458647:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458653:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458660:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa9c737ef (ffff98eaa1d46200) 00010000:00010000:2.0:1789498500.458662:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498500.458672:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.458678:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa9c737ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.458778:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10545:x1876424864619264:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 533us (8361us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789498500.458786:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:2.0:1789498500.461761:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498500.461846:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864619392 00000100:00100000:0.0:1789498500.461858:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864619392 00000100:00100000:0.0:1789498500.461918:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:0.0:1789498500.461928:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:10545:x1876424864619392:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498500.462210:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498500.462236:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18a24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a19d expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.462272:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.462286:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.462297:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.462408:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18a24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 58 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.462425:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 57 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.462433:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:0.0:1789498500.462435:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789498500.462439:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5800, rc 0) 00000100:00100000:0.0:1789498500.462492:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:10545:x1876424864619392:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 566us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498500.462499:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:1.0:1789498500.467893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498500.468181:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864619648 00000100:00100000:0.0:1789498500.468191:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864619648 00000100:00100000:0.0:1789498500.468258:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:0.0:1789498500.468268:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:10545:x1876424864619648:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789498500.468377:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.468394:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.468406:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498500.468693:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1789498500.468702:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400232611435ns, next at 401232609379ns, rc = 0 00000004:00010000:0.0:1789498500.468815:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca3d2b98 reply state 00000000475b3aeb transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498500.468825:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498500.469311:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:10545:x1876424864619648:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 672us (1054us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789498500.469322:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 119 00010000:00010000:2.0:1789498500.476417:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.476437:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.476445:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.476451:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498500.476456:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.476464:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.476483:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:2.0:1789498500.476486:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789498500.476491:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.476497:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc18a32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.479680:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498500.480251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864619776 00000100:00100000:3.0:1789498500.480263:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864619776 00000100:00100000:3.0:1789498500.480329:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:3.0:1789498500.480338:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+58:10545:x1876424864619776:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498500.480364:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498500.480386:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1a4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.480451:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.480466:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.480485:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:3.0:1789498500.480488:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498500.480492:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db400, rc 0) 00000100:00100000:3.0:1789498500.480585:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:10545:x1876424864619776:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 247us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498500.480592:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:1.0:1789498500.502373:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498500.502918:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864619904 00000100:00100000:3.0:1789498500.502940:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864619904 00000100:00100000:3.0:1789498500.503029:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:3.0:1789498500.503052:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864619904:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789498500.503439:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2356:x1876424864619904:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 399us (1077us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789498500.503447:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00080000:2.0:1789498500.503795:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498500.507480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498500.507969:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864620160 00000100:00100000:3.0:1789498500.507982:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864620160 00000100:00100000:3.0:1789498500.508212:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1789498500.508225:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:10545:x1876424864620160:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789498500.508493:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:10545:x1876424864620160:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 270us (1023us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789498500.508501:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:1.0:1789498500.512809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.513371:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864620416 00000100:00100000:2.0:1789498500.513382:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864620416 00000100:00100000:2.0:1789498500.513491:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:2.0:1789498500.513501:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:10545:x1876424864620416:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789498500.513625:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:10545:x1876424864620416:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 124us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498500.513641:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:1.0:1789498500.516946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498500.517188:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864620544 00000100:00100000:3.0:1789498500.517201:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864620544 00000100:00100000:3.0:1789498500.517269:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:3.0:1789498500.517280:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:10545:x1876424864620544:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498500.517305:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498500.517333:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1ab expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.517416:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.517439:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.517452:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498500.517497:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498500.517519:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.517551:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ab expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.517577:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ab expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.517586:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:3.0:1789498500.517589:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789498500.517594:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20da800, rc 0) 00000100:00100000:3.0:1789498500.517684:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:10545:x1876424864620544:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 406us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498500.517692:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:3.0:1789498500.522433:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498500.522569:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864620672 00000100:00100000:1.0:1789498500.522581:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864620672 00000100:00100000:1.0:1789498500.522654:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:1.0:1789498500.522665:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2355:x1876424864620672:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498500.522686:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498500.522709:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1b2 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498500.522760:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa99484, blocks: 0x1 00010000:00010000:1.0:1789498500.522783:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1789498500.522787:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498500.522796:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 10 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.522816:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 10 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.522828:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddea00, rc 0) 00000100:00100000:1.0:1789498500.523154:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2355:x1876424864620672:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 399us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498500.523164:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:1.0:1789498500.526623:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498500.526784:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864620928 00000100:00100000:0.0:1789498500.526795:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864620928 00000100:00100000:0.0:1789498500.526952:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:0.0:1789498500.526964:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:10545:x1876424864620928:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789498500.543778:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:10545:x1876424864620928:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 16288us (16639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498500.543796:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:3.0:1789498500.553723:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498500.553869:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864621056 00000100:00100000:1.0:1789498500.553880:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864621056 00000100:00100000:1.0:1789498500.553940:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:1.0:1789498500.553950:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:10545:x1876424864621056:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498500.553971:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498500.553991:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1b9 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.554031:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 11 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.554073:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498500.554078:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498500.554085:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.554150:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 11 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.554165:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 11 pid: 6701 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.554179:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6704:1876424885606272:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498500.554265:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789498500.564193:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6704:1876424885606272:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498500.564231:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.564253:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf200, rc 0) 00000100:00100000:1.0:1789498500.564319:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:10545:x1876424864621056:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 10370us (10607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498500.564329:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498500.565982:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.566138:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864621184 00000100:00100000:2.0:1789498500.566151:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864621184 00010000:00010000:2.0:1789498500.566199:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 11 pid: 6701 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.566241:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:2.0:1789498500.566252:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:2355:x1876424864621184:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498500.566266:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498500.566290:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 11 pid: 6701 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.566304:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 11 pid: 6701 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.566330:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc18a4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b2 expref: 11 pid: 6701 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.566369:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498500.566373:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498500.566383:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.566393:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.566433:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.566449:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876424885606400:192.168.201.20@tcp:105: 00000100:00100000:2.0:1789498500.566528:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea81254000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498500.574742:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876424885606400:192.168.201.20@tcp:105: 00010000:00010000:2.0:1789498500.574769:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498500.574827:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2355:x1876424864621184:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 8575us (8850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498500.574837:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:0.0:1789498500.578326:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.579457:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864621312 00000100:00100000:2.0:1789498500.579472:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864621312 00002000:00100000:2.0:1789498500.579533:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98eab9fbdc00 x1876424864621312/t0(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:531/0 lens 504/0 e 0 to 0 dl 1789498511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789498500.579546:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eab9fbdc00 with x1876424864621312 ext(0->12) 00002000:00010000:2.0:1789498500.579565:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eab9fbdc00 00000100:00100000:2.0:1789498500.579622:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:2.0:1789498500.579644:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2355:x1876424864621312:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789498500.580185:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:2355:x1876424864621312:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 Request processed in 553us (1868us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789498500.580193:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00002000:00100000:2.0:1789498500.580201:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98eab9fbdc00 x1876424864621312/t4294967308(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:531/0 lens 504/448 e 0 to 0 dl 1789498511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789498500.580209:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eab9fbdc00 with x1876424864621312 ext(0->12) 00002000:00010000:2.0:1789498500.580213:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eab9fbdc00 00000100:00100000:3.0:1789498500.597125:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498500.599073:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864621440 00000100:00100000:1.0:1789498500.599110:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864621440 00000100:00100000:1.0:1789498500.599176:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:1.0:1789498500.599202:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:10545:x1876424864621440:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789498500.678865:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789498500.678880:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1789498500.680835:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1789498500.680845:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1789498500.680924:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789498500.680935:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789498500.680948:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98eaba6ba6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789498500.680953:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98eabadd0000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98eaba6ba000 00000020:00080000:0.0:1789498500.680956:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98eabadd0c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98ea8803b000 00000020:00080000:0.0:1789498500.680987:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98ea90beccc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789498500.680991:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea88861b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98eaba59d780 00000020:00080000:0.0:1789498500.680994:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea88861c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98ea881b7000 00000020:00080000:0.0:1789498500.681002:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1789498500.681234:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789498500.681409:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789498500.681429:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885606528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789498500.681514:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498500.681609:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885606656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789498500.681635:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498500.681656:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498500.681662:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885606784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789498500.681687:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498500.681720:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885606528 00000100:00100000:0.0:1789498500.681727:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885606528 00000100:00100000:0.0:1789498500.681777:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885606656 00000100:00100000:0.0:1789498500.681780:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885606656 00000100:00100000:0.0:1789498500.681791:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885606784 00000100:00100000:0.0:1789498500.681793:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885606784 00000100:00100000:0.0:1789498500.681810:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789498500.681818:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876424885606528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789498500.681843:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789498500.681866:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.681887:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.681896:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789498500.681900:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498500.681905:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.681945:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.681960:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 11 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498500.681972:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1876424885606912:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498500.682028:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498500.682045:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789498500.682054:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885606656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789498500.682222:0:10445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789498500.682226:0:10445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789498500 00002000:00010000:0.0:1789498500.682229:0:10445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789498500.682231:0:10445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789498500 -> 1789498500 00002000:00010000:0.0:1789498500.682233:0:10445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789498500.682272:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1876424885606656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (635us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789498500.682279:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789498500.682299:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789498500.682305:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885606784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789498500.682318:0:10445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1789498500.682340:0:10445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa99482, atime: 0x6aa99482, ctime: 0x6aa99482, blocks: 0xb 00010000:00010000:0.0:1789498500.682345:0:10445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.682360:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1789498500.682363:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498500.682368:0:10445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.682382:0:10445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.682391:0:10445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.682397:0:10445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.682414:0:10445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789498500.682857:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885606784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 550us (1167us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789498500.682863:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789498500.682890:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498500.682894:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789498500.683010:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498500.683017:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.683026:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498500.683031:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.683047:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.683077:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.683086:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc18a63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.683129:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498500.683132:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498500.683133:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498500.683161:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789498500.683167:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1789498500.683185:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eab9fbc380, transno 4294967301 00000004:00080000:0.0:1789498500.683195:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1789498500.683209:0:3305:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98eab9fbf480 x1876424885606784/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789498516 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789498500.683219:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eab9fbf480/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789498500.683225:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885606784:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789498500.683237:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eab9fbc000/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789498500.683240:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885606656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789498500.684005:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:10545:x1876424864621440:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 Request processed in 84804us (86914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498500.684026:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:3.0:1789498500.687237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.687347:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864621568 00000100:00100000:2.0:1789498500.687358:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864621568 00010000:00010000:2.0:1789498500.687403:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 12 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.687446:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:2.0:1789498500.687457:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:2355:x1876424864621568:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498500.687472:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498500.687478:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 12 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.687493:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 12 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.687519:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498500.687523:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498500.687543:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.687559:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.687581:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498500.687628:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:2355:x1876424864621568:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 173us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498500.687644:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 57 00010000:00010000:1.0:1789498500.687802:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc6b7d3/0x3a6cb1946bc1881e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a118 expref: 11 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.687818:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1876424885606912:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498500.687840:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.687850:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.687858:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.687868:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.687876:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.687901:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789498500.688527:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3308:x1876424885606528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6708us (7011us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789498500.688537:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789498500.688692:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498500.688698:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.688708:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498500.688712:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.688720:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.688736:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.688744:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc18a5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.688776:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498500.688778:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498500.688779:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498500.691215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.691413:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864621696 00000100:00100000:2.0:1789498500.691424:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864621696 00000100:00100000:2.0:1789498500.691484:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:2.0:1789498500.691494:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:2356:x1876424864621696:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1789498500.696529:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eab9fbea00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789498500.696547:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885606528:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1789498500.747391:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1789498500.747413:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789498500.747421:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1789498500.747712:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864621696:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 Request processed in 56214us (56500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498500.747724:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:0.0:1789498500.750911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498500.751186:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864621952 00000100:00100000:3.0:1789498500.751196:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864621952 00000100:00100000:0.0:1789498500.751439:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:0.0:1789498500.751450:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:10545:x1876424864621952:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789498500.751508:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498500.751537:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ab expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.751570:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:0.0:1789498500.751576:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498500.751609:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.751624:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.751645:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498500.752168:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc589e4a reply state 00000000c2a9e02a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498500.752180:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498500.752342:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:10545:x1876424864621952:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 894us (1438us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789498500.752350:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00010000:00010000:2.0:1789498500.754800:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.754819:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.754827:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.754833:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498500.754838:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.754846:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.754864:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:2.0:1789498500.754867:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498500.754873:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.754879:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18a6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498500.759693:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498500.760071:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864622080 00000100:00100000:1.0:1789498500.760085:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864622080 00000100:00100000:1.0:1789498500.760174:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:1.0:1789498500.760184:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864622080:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789498500.760453:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789498500.760458:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789498500 -> 1789498499 00002000:00010000:1.0:1789498500.760460:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789498498 00002000:00010000:1.0:1789498500.760462:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789498500 -> 1789498499 00002000:00010000:1.0:1789498500.760464:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789498500.760527:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864622080:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 343us (844us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789498500.760534:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:1.0:1789498500.765757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.765853:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864622336 00000100:00100000:2.0:1789498500.765864:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864622336 00000100:00100000:2.0:1789498500.765924:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:2.0:1789498500.765944:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:10545:x1876424864622336:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789498500.766014:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.766033:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 15 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.766242:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.766292:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 15 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.766307:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 15 pid: 7250 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.766330:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885607040:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498500.766414:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea874a8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789498500.772723:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498500.772891:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864622464 00000100:00100000:1.0:1789498500.772902:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864622464 00010000:00010000:1.0:1789498500.772962:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 16 pid: 7250 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.773007:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:1.0:1789498500.773016:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:2356:x1876424864622464:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498500.773032:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498500.773046:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 16 pid: 7250 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.773086:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 16 pid: 7250 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.773142:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:1.0:1789498500.773148:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.773158:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.773165:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.773186:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498500.773234:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:2356:x1876424864622464:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 219us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498500.773242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00010000:00010000:2.0:1789498500.774365:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a19d expref: 15 pid: 7250 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.774385:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885607040:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498500.774406:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774425:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774431:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774467:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774474:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774480:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774486:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498500.774490:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774497:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774508:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:2.0:1789498500.774511:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789498500.774514:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.774519:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18a71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.774599:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:10545:x1876424864622336:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 Request processed in 8658us (8857us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789498500.774614:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:3.0:1789498500.778510:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498500.778621:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864622592 00000100:00100000:1.0:1789498500.778642:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864622592 00000100:00100000:1.0:1789498500.778700:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:1.0:1789498500.778710:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864622592:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789498500.778758:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.778778:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.778809:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498500.778815:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789498500.778820:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.778863:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.778877:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 7 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.778894:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1876424885607168:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498500.779210:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498500.787899:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498500.788033:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864622720 00000100:00100000:3.0:1789498500.788135:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864622720 00010000:00010000:3.0:1789498500.788183:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 8 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498500.788236:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:3.0:1789498500.788246:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864622720:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498500.788277:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498500.788312:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 8 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.788328:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 8 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.788355:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498500.788360:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498500.788380:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.788391:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.788411:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498500.788472:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864622720:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 227us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498500.788479:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00010000:00010000:1.0:1789498500.793115:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b308a8c0/0x3a6cb1946bc18a55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1b9 expref: 7 pid: 6704 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.793143:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1876424885607168:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498500.793172:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793184:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793192:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793266:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793277:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793287:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793294:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498500.793298:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793307:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793328:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.793335:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18a78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.793430:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864622592:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 Request processed in 14720us (14929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498500.793441:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:0.0:1789498500.796679:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.796861:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864622976 00000100:00100000:2.0:1789498500.796872:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864622976 00000100:00100000:2.0:1789498500.796939:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 127 00000100:00100000:2.0:1789498500.796949:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:10545:x1876424864622976:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789498500.797027:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.797053:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.797074:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.797336:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.797348:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.797356:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.797389:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.797403:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 15 pid: 5845 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.797430:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885607296:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498500.797515:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea874a8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498500.801789:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498500.802238:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885607296:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498500.802273:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.806610:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864623104 00000100:00100000:1.0:1789498500.806634:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864623104 00010000:00010000:1.0:1789498500.806689:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 16 pid: 5845 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.806800:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:1.0:1789498500.806810:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+16:2355:x1876424864623104:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498500.806825:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498500.806832:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 16 pid: 5845 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.806846:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 16 pid: 5845 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.806868:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1a4 expref: 16 pid: 5845 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.806887:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:1.0:1789498500.806893:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.806902:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.806910:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.806945:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498500.807010:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:2355:x1876424864623104:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 201us (5229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498500.807033:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00010000:00010000:0.0:1789498500.807545:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.807554:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498500.807775:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789498500.807956:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789498500.808008:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789498500.808304:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876424885607424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789498500.808366:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498500.808397:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498500.808425:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885607424 00000100:00100000:0.0:1789498500.808431:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885607424 00000100:00100000:0.0:1789498500.808470:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789498500.808479:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876424885607424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789498500.808553:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876424885607424:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498500.808560:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789498500.808597:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789498500.808603:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1789498500.808622:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eab9fbc000, transno 4294967309 00000004:00080000:0.0:1789498500.808644:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eab9fbea00, transno 4294967310 00000100:00100000:0.0:1789498500.808651:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876424885607424:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789498500.809780:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789498500.809864:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876424885607552:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789498500.809914:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498500.809954:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498500.810979:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885607552 00000100:00100000:2.0:1789498500.810996:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885607552 00000100:00100000:2.0:1789498500.811204:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498500.811216:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876424885607552:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789498500.811467:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876424885607552:12345-0@lo:1000:mdt00_001.0 Request processed in 254us (1552us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789498500.811474:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498500.811911:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876424885607552:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789498500.811972:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.811984:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.811991:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.811997:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498500.812002:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812011:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812027:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea84ebfe00) 00010000:00010000:0.0:1789498500.812029:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498500.812034:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812189:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18a86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812224:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812230:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812250:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812255:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498500.812258:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812264:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812271:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:0.0:1789498500.812274:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498500.812279:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a188 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812290:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a188 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812299:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a188 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.812331:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a188 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498500.812346:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885607680:192.168.201.20@tcp:105: 00000100:00100000:0.0:1789498500.812421:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498500.816358:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498500.818975:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885607680:192.168.201.20@tcp:105: 00010000:00010000:1.0:1789498500.819012:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819025:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc189c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819081:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819119:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819131:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819142:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819149:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819155:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819161:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498500.819166:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819173:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819200:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:1.0:1789498500.819203:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498500.819208:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819213:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18a8d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819223:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819229:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819234:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819239:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498500.819242:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819248:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819255:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:1.0:1789498500.819257:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789498500.819260:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498500.819265:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18a7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498500.819522:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:10545:x1876424864622976:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 22572us (22850us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789498500.819533:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 127 00000020:00080000:1.0:1789498500.819539:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789498500.820892:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498500.820899:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498500.821419:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789498500.821427:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789498500.825682:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864623232 00000100:00100000:3.0:1789498500.825701:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864623232 00000100:00100000:0.0:1789498500.825997:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498500.826070:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864623488 00000100:00100000:3.0:1789498500.826075:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864623488 00000100:00100000:3.0:1789498500.826378:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1789498500.826391:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5955c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:10545:x1876424864623488:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789498500.827735:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789498500.827831:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1789498500.827883:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.827900:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.827911:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.827920:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.827937:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.827943:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498500.828025:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789498500.828172:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5955c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10545:x1876424864623488:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 1780us (2175us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789498500.828180:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000020:00080000:3.0:1789498500.828185:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789498500.830831:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:2.0:1789498500.830846:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:10544:x1876424864623232:12345-192.168.201.20@tcp:49:lfs.0 00000100:00100000:2.0:1789498500.830993:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:10544:x1876424864623232:12345-192.168.201.20@tcp:49:lfs.0 Request processed in 150us (14646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498500.831001:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1789498500.834589:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:0.0:1789498500.835414:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498500.835426:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.835438:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498500.835443:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.835453:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.835472:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98ea9108c600) 00010000:00010000:0.0:1789498500.835475:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789498500.835480:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.835486:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18a94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.835516:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498500.835518:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498500.835520:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498500.837790:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864623744 00000100:00100000:1.0:1789498500.837807:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864623744 00000100:00100000:1.0:1789498500.837882:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00100000:1.0:1789498500.837894:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:10544:x1876424864623744:12345-192.168.201.20@tcp:58:lfs.0 00000040:00080000:1.0:1789498500.838246:0:7250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789498500.838342:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:10544:x1876424864623744:12345-192.168.201.20@tcp:58:lfs.0 Request processed in 450us (3764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498500.838351:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00100000:2.0:1789498500.865254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498500.865417:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864623872 00000100:00100000:0.0:1789498500.865428:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864623872 00000100:00100000:0.0:1789498500.865482:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 129 00000100:00100000:0.0:1789498500.865490:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:10547:x1876424864623872:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498500.865511:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498500.865528:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18a9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1c0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865608:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865620:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865634:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865646:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865651:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865655:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865856:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865867:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865876:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865916:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.865943:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 21 pid: 5846 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498500.865957:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885607808:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498500.866044:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea851fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498500.869583:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.869817:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864624128 00000100:00100000:2.0:1789498500.869825:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864624128 00000100:00100000:2.0:1789498500.869876:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:2.0:1789498500.869886:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:5598:x1876424864624128:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789498500.870240:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:5598:x1876424864624128:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 356us (668us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789498500.870263:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:0.0:1789498500.870954:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885607808:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498500.870983:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498500.874828:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498500.875227:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864624256 00000100:00100000:2.0:1789498500.875239:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864624256 00010000:00010000:2.0:1789498500.875287:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 23 pid: 5846 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498500.875332:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:2.0:1789498500.875342:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85663450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:2355:x1876424864624256:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498500.875359:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498500.875367:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 23 pid: 5846 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.875381:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 23 pid: 5846 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.875405:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc189bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a181 expref: 23 pid: 5846 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.875422:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498500.875428:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.875438:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.875446:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498500.875501:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498500.875657:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85663450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:2355:x1876424864624256:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 317us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498500.875663:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00010000:00010000:0.0:1789498500.875752:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875758:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498500.875800:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789498500.875803:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498500.875817:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875826:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875834:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875838:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875851:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875855:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498500.875858:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875863:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875869:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:0.0:1789498500.875871:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498500.875874:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875878:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18aa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875885:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875888:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875892:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875895:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498500.875897:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875907:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875912:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98ea84ebfe00) 00010000:00010000:0.0:1789498500.875913:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498500.875915:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875918:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875944:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18a9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1c0 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875953:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1c0 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498500.875957:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:0.0:1789498500.875959:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789498500.875960:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4000, rc 0) 00000100:00100000:0.0:1789498500.875982:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10547:x1876424864623872:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 10493us (10736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498500.875987:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 129 00010000:00010000:0.0:1789498501.035266:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498501.515393:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789498501.515405:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498501.515459:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789498501.515464:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789498501.867518:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498501.867539:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498501.867584:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789498501.867591:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789498501.869584:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885607936:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789498501.871209:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba780 going to sleep for 11 seconds 00000100:00100000:0.0:1789498501.879500:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885607936:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789498501.885252:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498501.886822:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864624384 00000100:00100000:3.0:1789498501.886837:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864624384 00000100:00100000:3.0:1789498501.886927:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:3.0:1789498501.886939:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10559:x1876424864624384:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498501.886985:0:7250:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498501.887187:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10559:x1876424864624384:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 250us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498501.887195:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:3.0:1789498501.893013:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498501.893131:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864624640 00000100:00100000:1.0:1789498501.893142:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864624640 00000100:00100000:1.0:1789498501.893201:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:1.0:1789498501.893211:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:10559:x1876424864624640:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498501.893235:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498501.893258:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18ab7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1c7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498501.893381:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498501.893395:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498501.893427:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498501.893440:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789498501.893596:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18ab7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1c7 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498501.893617:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1c7 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498501.893626:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:1.0:1789498501.893629:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498501.893634:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddee00, rc 0) 00000100:00100000:1.0:1789498501.893705:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:10559:x1876424864624640:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 496us (704us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789498501.893713:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:0.0:1789498501.906325:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498501.906381:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498501.906456:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864624896 00000100:00100000:3.0:1789498501.906468:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864624896 00000100:00100000:3.0:1789498501.906556:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:3.0:1789498501.906567:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:10559:x1876424864624896:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789498501.906697:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.906716:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.906729:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.908108:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.908125:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.908132:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.908137:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498501.908142:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.908150:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.908163:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:3.0:1789498501.908167:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789498501.908172:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498501.908178:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18acc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498501.908389:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:10559:x1876424864624896:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 1822us (2079us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789498501.908398:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 132 00000040:00080000:2.0:1789498501.908475:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789498501.908480:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498501.908969:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789498501.908978:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789498501.912690:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498501.912862:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864625024 00000100:00100000:1.0:1789498501.912875:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864625024 00000100:00100000:1.0:1789498501.912964:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:1.0:1789498501.912977:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2356:x1876424864625024:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498501.912997:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498501.913027:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1c7 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498501.913059:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:1.0:1789498501.913065:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498501.913152:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:2356:x1876424864625024:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 178us (6769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498501.913160:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:0.0:1789498501.919728:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864625280 00000100:00100000:0.0:1789498501.919748:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864625280 00000100:00100000:0.0:1789498501.919825:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:0.0:1789498501.919836:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:10559:x1876424864625280:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789498501.920568:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:10559:x1876424864625280:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 732us (7886us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789498501.920579:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00010000:00010000:0.0:1789498502.059454:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498502.545930:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498502.545983:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498502.546021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498502.546062:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498502.546119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498502.546333:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864625408 00000100:00100000:1.0:1789498502.546343:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864625408 00000100:00100000:1.0:1789498502.546400:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 292 00000100:00100000:1.0:1789498502.546410:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864625408:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498502.546482:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2355:x1876424864625408:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 74us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498502.546489:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 292 00000100:00100000:0.0:1789498502.546885:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864625664 00000100:00100000:0.0:1789498502.546890:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864625664 00000100:00100000:0.0:1789498502.546935:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864625792 00000100:00100000:0.0:1789498502.546938:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864625792 00000100:00100000:0.0:1789498502.546972:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:0.0:1789498502.546980:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864625664:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498502.547017:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864625664:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498502.547024:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:0.0:1789498502.547045:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:0.0:1789498502.547052:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864625792:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498502.547077:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864625792:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498502.547121:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:0.0:1789498502.547139:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864625920 00000100:00100000:0.0:1789498502.547142:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864625920 00000100:00100000:0.0:1789498502.547172:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864625536 00000100:00100000:0.0:1789498502.547175:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864625536 00000100:00100000:0.0:1789498502.547192:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 149 00000100:00100000:0.0:1789498502.547198:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864625920:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498502.547225:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2355:x1876424864625920:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498502.547232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 149 00000100:00100000:0.0:1789498502.547243:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 150 00000100:00100000:0.0:1789498502.547249:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2355:x1876424864625536:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498502.547275:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2355:x1876424864625536:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498502.547281:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 150 00000100:00080000:1.0:1789498502.548769:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498502.548778:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498502.548781:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789498503.085746:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498503.660297:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885608192:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.660367:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498503.660424:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885608704:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.660463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498503.660498:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789498503.660504:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885608064:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.660533:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498503.660554:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885608576:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.660575:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498503.660599:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885608320:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.660620:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498503.660639:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498503.660644:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885608448:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.660665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498503.660698:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885608192 00000100:00100000:3.0:1789498503.660713:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885608192 00000100:00100000:3.0:1789498503.660756:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885608576 00000100:00100000:3.0:1789498503.660759:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885608576 00000100:00100000:3.0:1789498503.660780:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885608320 00000100:00100000:3.0:1789498503.660783:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885608320 00000100:00100000:3.0:1789498503.660799:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789498503.660807:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885608192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.660928:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885608192:12345-0@lo:400:kworker.0 Request processed in 121us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498503.660936:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789498503.660955:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789498503.660961:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885608576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.660989:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885608576:12345-0@lo:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498503.660994:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789498503.661017:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789498503.661024:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885608320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661056:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885608320:12345-0@lo:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498503.661063:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789498503.661083:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885608704 00000100:00100000:3.0:1789498503.661114:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885608704 00000100:00100000:3.0:1789498503.661140:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885608448 00000100:00100000:3.0:1789498503.661143:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885608448 00000100:00100000:3.0:1789498503.661165:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789498503.661171:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876424885608704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661200:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876424885608704:12345-0@lo:400:kworker.0 Request processed in 30us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498503.661215:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789498503.661229:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789498503.661235:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885608448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661264:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885608448:12345-0@lo:400:kworker.0 Request processed in 30us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498503.661270:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789498503.661287:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885608064 00000100:00100000:3.0:1789498503.661290:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885608064 00000100:00100000:3.0:1789498503.661313:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789498503.661319:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885608064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661346:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885608064:12345-0@lo:400:kworker.0 Request processed in 28us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498503.661352:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:3.0:1789498503.661385:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498503.661389:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498503.661391:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498503.661428:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885608448:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661440:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885608320:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661468:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885608064:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661477:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885608576:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661485:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885608192:0@lo:400:kworker.0 00000100:00100000:3.0:1789498503.661494:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885608704:0@lo:400:kworker.0 00000040:00080000:0.0:1789498503.782723:0:12114:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498503.782732:0:12114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498503.782779:0:12114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789498503.782784:0:12114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789498504.121842:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498504.175151:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498504.176329:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864626176 00000100:00100000:3.0:1789498504.176352:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864626176 00000100:00100000:3.0:1789498504.176419:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:3.0:1789498504.176430:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:10579:x1876424864626176:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498504.176452:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498504.176478:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1ce expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.176606:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18ada lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.176621:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18ada lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.176633:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18ada lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498504.176645:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789498504.176778:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18ad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ce expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.176798:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18ada lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ce expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.176807:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:3.0:1789498504.176810:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789498504.176814:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db000, rc 0) 00000100:00100000:3.0:1789498504.176871:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:10579:x1876424864626176:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 442us (1729us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789498504.176880:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00080000:2.0:1789498504.177064:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498504.181354:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498504.181377:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885608832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498504.181449:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498504.181908:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885608960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498504.181951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498504.182204:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885608832 00000100:00100000:2.0:1789498504.182212:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885608832 00000100:00100000:2.0:1789498504.182263:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885608960 00000100:00100000:2.0:1789498504.182267:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885608960 00000100:00100000:2.0:1789498504.182284:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789498504.182294:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885608832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498504.182328:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498504.182394:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789498504.182404:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885608960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498504.182427:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498504.182856:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885608832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 563us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498504.182865:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789498504.184739:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885608960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2330us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498504.184749:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789498504.185059:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885608960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498504.185076:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885608832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498504.188881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498504.189021:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864626304 00000100:00100000:3.0:1789498504.189032:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864626304 00000100:00100000:3.0:1789498504.189195:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:3.0:1789498504.189207:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:10579:x1876424864626304:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:3.0:1789498504.189277:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189295:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189307:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189335:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189343:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189351:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189377:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498504.189382:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189390:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189404:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:3.0:1789498504.189407:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498504.189412:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498504.189419:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ae8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498504.189612:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:10579:x1876424864626304:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 408us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498504.189621:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:3.0:1789498504.353409:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498504.356550:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864626432 00000100:00100000:0.0:1789498504.356566:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864626432 00000100:00100000:0.0:1789498504.356667:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:0.0:1789498504.356679:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864626432:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:0.0:1789498504.356701:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498504.356739:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61de97b/0x3a6cb1946bc18aef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1d5 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789498504.356770:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa99483, atime: 0x6aa99482, ctime: 0x6aa99483, blocks: 0xb 00010000:00010000:0.0:1789498504.356792:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1789498504.356797:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498504.356807:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61de97b/0x3a6cb1946bc18aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1d5 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498504.356830:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d61de97b/0x3a6cb1946bc18aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1d5 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498504.356844:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4600, rc 0) 00000100:00100000:0.0:1789498504.356912:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864626432:12345-192.168.201.20@tcp:101:cat.0 Request processed in 235us (3514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498504.356919:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00080000:2.0:1789498504.357262:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498504.362507:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498504.364722:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864626560 00000100:00100000:3.0:1789498504.364737:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864626560 00002000:00100000:3.0:1789498504.364796:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98eabad0df80 x1876424864626560/t0(0) o3->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:535/0 lens 488/0 e 0 to 0 dl 1789498515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789498504.364809:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabad0df80 with x1876424864626560 ext(0->4095) 00002000:00010000:3.0:1789498504.364815:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eabad0df80 00000100:00100000:3.0:1789498504.364854:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1789498504.364864:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2358:x1876424864626560:12345-192.168.201.20@tcp:3:cat.0 00000100:00100000:3.0:1789498504.365153:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2358:x1876424864626560:12345-192.168.201.20@tcp:3:cat.0 Request processed in 290us (2656us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789498504.365161:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00002000:00100000:3.0:1789498504.365168:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98eabad0df80 x1876424864626560/t0(0) o3->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:535/0 lens 488/4536 e 0 to 0 dl 1789498515 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789498504.365177:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabad0df80 with x1876424864626560 ext(0->4095) 00002000:00010000:3.0:1789498504.365181:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eabad0df80 00010000:00010000:0.0:1789498505.132597:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789498505.807278:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1789498505.807304:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98ea851fa000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789498505.807311:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea83f65500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98ea851fa240 00000020:00080000:3.0:1789498505.807315:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea83f65300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98eaba4c4000 00000001:00080000:1.0:1789498505.807339:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000020:00080000:3.0:1789498505.807342:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789498505.807352:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000020:00080000:2.0:1789498505.814025:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789498505.814399:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789498505.817821:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789498505.818643:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00010000:00010000:0.0:1789498506.164877:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498507.182375:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498507.678119:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498507.678161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498507.678192:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498507.678215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498507.678241:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498507.678290:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864626688 00000100:00100000:0.0:1789498507.678307:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864626688 00000100:00100000:0.0:1789498507.678382:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 294 00000100:00100000:0.0:1789498507.678404:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864626688:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498507.678544:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864627072 00000100:00100000:1.0:1789498507.678549:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864627072 00000100:00100000:1.0:1789498507.678599:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864626944 00000100:00100000:1.0:1789498507.678602:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864626944 00000100:00100000:1.0:1789498507.678629:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1789498507.678639:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864627072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498507.678733:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864627072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 95us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498507.678741:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1789498507.678761:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:1.0:1789498507.678768:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864626944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498507.678793:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864626944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498507.678800:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00080000:1.0:1789498507.678819:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498507.678825:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498507.678861:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864626816 00000100:00100000:1.0:1789498507.678865:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864626816 00000100:00100000:1.0:1789498507.678898:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864627200 00000100:00100000:1.0:1789498507.678902:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864627200 00000100:00100000:1.0:1789498507.678925:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:1.0:1789498507.678932:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:2358:x1876424864626816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498507.678980:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:2358:x1876424864626816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 48us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498507.678988:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:1.0:1789498507.679000:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00100000:1.0:1789498507.679006:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864627200:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498507.679031:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864627200:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498507.679038:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00080000:1.0:1789498507.679065:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498507.680661:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864626688:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 2250us (2456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498507.680676:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 294 00000040:00080000:0.0:1789498508.075402:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498508.075415:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498508.075465:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789498508.075471:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789498508.205137:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498508.780160:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885609088:0@lo:400:kworker.0 00000100:00100000:0.0:1789498508.780270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498508.780401:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885609088 00000100:00100000:3.0:1789498508.780423:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885609088 00000100:00100000:3.0:1789498508.780503:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789498508.780514:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885609088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498508.782156:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885609216:0@lo:400:kworker.0 00000100:00100000:1.0:1789498508.782238:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498508.782309:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885609216 00000100:00100000:1.0:1789498508.782318:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885609216 00000100:00100000:1.0:1789498508.782373:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789498508.782382:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885609216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498508.782447:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885609216:12345-0@lo:400:kworker.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498508.782454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789498508.782516:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885609216:0@lo:400:kworker.0 00000100:00100000:3.0:1789498508.786842:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885609088:12345-0@lo:400:kworker.0 Request processed in 6312us (6556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498508.786863:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789498508.787382:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885609728:0@lo:400:kworker.0 00000100:00100000:2.0:1789498508.787478:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498508.787782:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885609344:0@lo:400:kworker.0 00000100:00100000:1.0:1789498508.787836:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498508.787885:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498508.787892:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885609472:0@lo:400:kworker.0 00000100:00100000:1.0:1789498508.788026:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885609344 00000100:00100000:1.0:1789498508.788037:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885609344 00000100:00100000:1.0:1789498508.788129:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789498508.788140:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885609344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498508.788208:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885609344:12345-0@lo:400:kworker.0 Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498508.788215:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1789498508.788237:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498508.788908:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498508.788935:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885609600:0@lo:400:kworker.0 00000100:00100000:2.0:1789498508.788975:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498508.789010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498508.789057:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885609344:0@lo:400:kworker.0 00000100:00100000:3.0:1789498508.789184:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885609600 00000100:00100000:3.0:1789498508.789190:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885609600 00000100:00100000:3.0:1789498508.789245:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789498508.789253:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885609600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498508.789308:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885609600:12345-0@lo:400:kworker.0 Request processed in 55us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498508.789332:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789498508.789418:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885609728 00000100:00100000:1.0:1789498508.789429:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885609728 00000100:00100000:1.0:1789498508.789468:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885609472 00000100:00100000:1.0:1789498508.789471:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885609472 00000100:00100000:1.0:1789498508.789501:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789498508.789508:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885609728:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789498508.793820:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498508.793841:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498508.793847:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498508.793950:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885609600:0@lo:400:kworker.0 00000100:00100000:2.0:1789498508.793972:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789498508.793980:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789498508.794012:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885609728:0@lo:400:kworker.0 00000100:00100000:2.0:1789498508.794151:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789498508.794178:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885609472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498508.795581:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885609088:0@lo:400:kworker.0 00000100:00100000:2.0:1789498508.797467:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885609472:12345-0@lo:400:kworker.0 Request processed in 3286us (8437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498508.797749:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789498508.798132:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885609728:12345-0@lo:400:kworker.0 Request processed in 8622us (10652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498508.798142:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789498508.803033:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789498508.803056:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eab9fbf480, transno 4294967304 00000100:00100000:3.0:1789498508.803116:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885609472:0@lo:400:kworker.0 00010000:00010000:0.0:1789498509.227453:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498509.293701:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498509.293738:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885609856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498509.293843:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498509.293947:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885609856 00000100:00100000:0.0:1789498509.293956:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885609856 00000100:00100000:0.0:1789498509.294018:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789498509.294029:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885609856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498509.294085:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498509.294163:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885609856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498509.294172:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789498509.294230:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885609856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498509.298485:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885609984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498509.298589:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498509.298850:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885609984 00000100:00100000:1.0:1789498509.298862:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885609984 00000100:00100000:1.0:1789498509.298942:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789498509.298955:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885609984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498509.299008:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498509.299073:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885609984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498509.299081:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789498509.299167:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885609984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498510.252431:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498510.621921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498510.622131:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864627328 00000100:00100000:1.0:1789498510.622148:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864627328 00000100:00100000:1.0:1789498510.622233:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:1.0:1789498510.622247:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:10231:x1876424864627328:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789498510.622412:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:10231:x1876424864627328:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 Request processed in 168us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498510.622421:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00080000:2.0:1789498510.622502:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498510.634559:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498510.634983:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864627584 00000100:00100000:0.0:1789498510.635000:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864627584 00000100:00100000:0.0:1789498510.635082:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:0.0:1789498510.635145:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:10231:x1876424864627584:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789498510.635648:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:10231:x1876424864627584:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 505us (1101us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789498510.635657:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000001:00080000:0.0:1789498510.923204:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789498510.923235:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789498510.923292:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789498510.923315:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789498511.275665:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498512.299576:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498512.788014:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498512.788076:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498512.788141:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498512.788166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498512.788197:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498512.788230:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864627712 00000100:00100000:0.0:1789498512.788243:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864627712 00000100:00100000:0.0:1789498512.788312:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 296 00000100:00100000:0.0:1789498512.788324:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864627712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498512.788414:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864627712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498512.788422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 296 00000100:00100000:3.0:1789498512.788577:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864628096 00000100:00100000:3.0:1789498512.788582:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864628096 00000100:00100000:3.0:1789498512.788639:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864627968 00000100:00100000:3.0:1789498512.788643:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864627968 00000100:00100000:3.0:1789498512.788669:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:3.0:1789498512.788677:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2357:x1876424864628096:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498512.788713:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2357:x1876424864628096:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498512.788720:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:3.0:1789498512.788734:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1789498512.788740:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864627968:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498512.788765:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864627968:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498512.788771:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1789498512.788795:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864627840 00000100:00100000:3.0:1789498512.788799:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864627840 00000100:00100000:3.0:1789498512.788830:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864628224 00000100:00100000:3.0:1789498512.788833:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864628224 00000100:00100000:3.0:1789498512.788864:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 159 00000100:00100000:3.0:1789498512.788871:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:2357:x1876424864627840:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498512.788931:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:2357:x1876424864627840:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 61us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498512.788939:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 159 00000100:00100000:3.0:1789498512.788951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 160 00000100:00100000:3.0:1789498512.788957:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864628224:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498512.788980:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864628224:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498512.788986:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 160 00000100:00080000:0.0:1789498512.791398:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498512.791414:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498512.791417:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789498513.323578:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789498513.781685:0:12316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:55:11 (1789498511) 00000100:00100000:1.0:1789498513.899527:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885610368:0@lo:400:kworker.0 00000100:00100000:1.0:1789498513.899648:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498513.899722:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498513.899730:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885610496:0@lo:400:kworker.0 00000100:00100000:1.0:1789498513.899759:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498513.899945:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885610240:0@lo:400:kworker.0 00000100:00100000:0.0:1789498513.900690:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885610112:0@lo:400:kworker.0 00000100:00100000:1.0:1789498513.906422:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885610368 00000100:00100000:1.0:1789498513.906441:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885610368 00000100:00100000:1.0:1789498513.906523:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789498513.906537:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885610368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498513.906713:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885610368:12345-0@lo:400:kworker.0 Request processed in 179us (7064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498513.906722:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789498513.906753:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885610496 00000100:00100000:1.0:1789498513.906758:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885610496 00000100:00100000:1.0:1789498513.906873:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789498513.906881:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885610496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498513.906919:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885610496:12345-0@lo:400:kworker.0 Request processed in 39us (7159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498513.906925:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789498513.906993:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885610496:0@lo:400:kworker.0 00000100:00100000:1.0:1789498513.907007:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885610368:0@lo:400:kworker.0 00000100:00080000:2.0:1789498513.907220:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498513.907227:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498513.907763:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498513.908007:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498513.908041:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885610240 00000100:00100000:3.0:1789498513.908048:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885610240 00000100:00100000:3.0:1789498513.908113:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789498513.908123:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885610240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498513.908170:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885610240:12345-0@lo:400:kworker.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498513.908177:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789498513.908212:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885610240:0@lo:400:kworker.0 00000100:00100000:3.0:1789498513.908226:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885610752:0@lo:400:kworker.0 00000100:00100000:3.0:1789498513.908257:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498513.908279:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885610752 00000100:00100000:3.0:1789498513.908283:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885610752 00000100:00100000:3.0:1789498513.908320:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789498513.908327:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885610752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498513.908360:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885610752:12345-0@lo:400:kworker.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498513.908384:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789498513.908421:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885610752:0@lo:400:kworker.0 00000100:00080000:3.0:1789498513.908457:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498513.908556:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885610624:0@lo:400:kworker.0 00000100:00100000:1.0:1789498513.908582:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498513.913242:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885610624 00000100:00100000:3.0:1789498513.913267:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885610624 00000100:00100000:3.0:1789498513.913369:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789498513.913382:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885610624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498513.913521:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885610624:12345-0@lo:400:kworker.0 Request processed in 142us (4938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498513.913529:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789498513.913590:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885610624:0@lo:400:kworker.0 00000100:00080000:1.0:1789498513.913901:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498513.914019:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885610112 00000100:00100000:2.0:1789498513.914026:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885610112 00000100:00100000:3.0:1789498513.914241:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789498513.914250:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885610112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498513.914309:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885610112:12345-0@lo:400:kworker.0 Request processed in 61us (6547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498513.914316:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789498513.914388:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885610112:0@lo:400:kworker.0 00010000:00010000:2.0:1789498514.354998:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498514.411970:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885610880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498514.412142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498514.412367:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885610880 00000100:00100000:2.0:1789498514.412380:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885610880 00000100:00100000:2.0:1789498514.412685:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789498514.412699:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885610880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498514.412756:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498514.412844:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885610880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498514.412852:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789498514.412947:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885610880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498514.413438:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885611008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498514.413481:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498514.417784:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885611008 00000100:00100000:1.0:1789498514.417802:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885611008 00000100:00100000:1.0:1789498514.417877:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789498514.417888:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885611008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498514.417946:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498514.418199:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885611008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 312us (4716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498514.418207:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789498514.418687:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885611008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789498515.372605:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498515.643972:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498515.645462:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864628480 00000100:00100000:3.0:1789498515.645479:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864628480 00000100:00100000:3.0:1789498515.645585:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:3.0:1789498515.645599:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:11289:x1876424864628480:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498515.645645:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498515.645672:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18af6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1dc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.645785:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.645820:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.645835:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.645855:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.645862:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.645869:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646265:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18b0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646276:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18b0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646282:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18b0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498515.646293:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789498515.646487:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646497:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646505:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646512:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498515.646518:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646527:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646540:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98eaa1d46700) 00010000:00010000:3.0:1789498515.646544:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498515.646550:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646557:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18afd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646576:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646583:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646590:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646606:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498515.646609:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646615:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646623:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98ea9108ca00) 00010000:00010000:3.0:1789498515.646625:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498515.646628:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.646634:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18b04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.647223:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18af6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1dc expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.647243:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18b0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1dc expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498515.647253:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:3.0:1789498515.647256:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498515.647258:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498515.647343:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:11289:x1876424864628480:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1748us (3386us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789498515.647354:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00080000:1.0:1789498515.648302:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498515.658244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498515.660310:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498515.660593:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864628608 00000100:00100000:0.0:1789498515.660624:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864628608 00000100:00100000:0.0:1789498515.660724:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:0.0:1789498515.660738:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:2355:x1876424864628608:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498515.660761:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498515.660807:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18b0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1dc expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498515.660839:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:0.0:1789498515.660846:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498515.661131:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2355:x1876424864628608:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 395us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498515.661140:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1789498515.662053:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864628736 00000100:00100000:1.0:1789498515.662077:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864628736 00000100:00100000:1.0:1789498515.662158:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:1.0:1789498515.662168:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:11289:x1876424864628736:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789498515.662278:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:11289:x1876424864628736:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 Request processed in 111us (4049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498515.662298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 137 00000001:00080000:2.0:1789498516.041085:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:2.0:1789498516.269156:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789498516.269167:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498516.270205:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789498516.270217:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789498516.407833:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498517.420160:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498517.907282:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498517.907332:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498517.907376:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498517.907399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498517.907430:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498517.907465:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864628864 00000100:00100000:0.0:1789498517.907478:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864628864 00000100:00100000:0.0:1789498517.907547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 298 00000100:00100000:0.0:1789498517.907560:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864628864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498517.907659:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864628864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 101us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498517.907667:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 298 00000100:00100000:0.0:1789498517.907708:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864629248 00000100:00100000:0.0:1789498517.907713:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864629248 00000100:00100000:0.0:1789498517.907764:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864629120 00000100:00100000:0.0:1789498517.907783:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864629120 00000100:00100000:0.0:1789498517.907805:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:0.0:1789498517.907811:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864629248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498517.908226:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2358:x1876424864629248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 413us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498517.908235:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:0.0:1789498517.908307:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:0.0:1789498517.908314:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864629120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498517.909536:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864629120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1220us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498517.909545:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:0.0:1789498517.909579:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864628992 00000100:00100000:0.0:1789498517.909597:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864628992 00000100:00100000:0.0:1789498517.909651:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864629376 00000100:00100000:0.0:1789498517.909655:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864629376 00000100:00100000:0.0:1789498517.909684:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:0.0:1789498517.909691:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:2358:x1876424864628992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498517.909724:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:2358:x1876424864628992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498517.909730:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:0.0:1789498517.909741:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:0.0:1789498517.909749:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864629376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498517.909781:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864629376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498517.909788:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00080000:0.0:1789498517.909836:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498517.909842:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498517.909845:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789498518.320483:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789498518.320494:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498518.321754:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789498518.321766:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789498518.443269:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498518.741834:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498518.742134:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864629504 00000100:00100000:0.0:1789498518.742146:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864629504 00000100:00100000:0.0:1789498518.742208:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:0.0:1789498518.742219:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:11332:x1876424864629504:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498518.742242:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498518.742262:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1e3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742332:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742348:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742360:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742375:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742382:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742389:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742574:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742587:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742592:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742595:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498518.742599:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742604:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742614:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:0.0:1789498518.742617:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498518.742621:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742625:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742633:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742636:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742639:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742643:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498518.742648:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742652:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742656:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98ea84ebff00) 00010000:00010000:0.0:1789498518.742658:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498518.742659:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742662:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742691:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18b19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1e3 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742701:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:0.0:1789498518.742702:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498518.742706:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1e3 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498518.742714:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5400, rc 0) 00000100:00100000:0.0:1789498518.742793:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:11332:x1876424864629504:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 574us (965us total) trans 0 rc 301/301 00000100:00100000:0.0:1789498518.742800:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:3.0:1789498518.785419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498518.785503:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864629760 00000100:00100000:1.0:1789498518.785513:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864629760 00000100:00100000:1.0:1789498518.785575:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 139 00000100:00100000:1.0:1789498518.785587:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:11332:x1876424864629760:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:1.0:1789498518.785673:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498518.785702:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc184a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a023 expref: 13 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.785750:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98eaa1d46800) 00010000:00010000:1.0:1789498518.785762:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498518.786003:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.786018:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.786028:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.786041:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.786047:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.786054:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498518.787000:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789498518.787013:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.787021:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.787028:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.787034:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddec00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498518.787044:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.787052:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.787063:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1c00) 00010000:00010000:1.0:1789498518.787066:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498518.787070:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.787077:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498518.787115:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060567d9d reply state 00000000d39f2694 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498518.787125:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789498518.787216:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:11332:x1876424864629760:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 1629us (1806us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789498518.787225:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 139 00010000:00010000:1.0:1789498518.792384:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.792403:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.792411:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.792416:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498518.792422:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.792443:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.792459:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98ea930e1700) 00010000:00010000:1.0:1789498518.792462:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498518.792467:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498518.792472:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b35 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498519.021872:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885611136:0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.021943:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498519.022008:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885611648:0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.022042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498519.022071:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789498519.022077:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885611264:0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.022125:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498519.022139:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885611776:0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.022161:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498519.022189:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885611648 00000100:00100000:2.0:1789498519.022195:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885611648 00000100:00100000:2.0:1789498519.022244:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885611264 00000100:00100000:2.0:1789498519.022247:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885611264 00000100:00100000:2.0:1789498519.022267:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789498519.022275:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885611648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.022327:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885611648:12345-0@lo:400:kworker.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498519.022334:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789498519.022349:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789498519.022355:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885611264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.022381:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885611264:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498519.022387:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1789498519.022402:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498519.022433:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885611264:0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.022462:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885611648:0@lo:400:kworker.0 00000100:00100000:0.0:1789498519.022655:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885611136 00000100:00100000:0.0:1789498519.022660:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885611136 00000100:00100000:0.0:1789498519.022688:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789498519.022694:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885611136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498519.022748:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885611136:12345-0@lo:400:kworker.0 Request processed in 53us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498519.022754:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789498519.023383:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885611520:0@lo:400:kworker.0 00000100:00100000:3.0:1789498519.023420:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498519.023451:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498519.023458:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885611392:0@lo:400:kworker.0 00000100:00100000:3.0:1789498519.023478:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498519.023531:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885611776 00000100:00100000:0.0:1789498519.023537:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885611776 00000100:00100000:0.0:1789498519.023577:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885611520 00000100:00100000:0.0:1789498519.023581:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885611520 00000100:00100000:0.0:1789498519.023609:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789498519.023616:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885611776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498519.023649:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885611776:12345-0@lo:400:kworker.0 Request processed in 34us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498519.023655:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789498519.023667:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789498519.023673:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885611520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498519.023697:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885611520:12345-0@lo:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498519.023702:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789498519.023809:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885611392 00000100:00100000:1.0:1789498519.023813:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885611392 00000100:00100000:1.0:1789498519.023867:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789498519.023874:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885611392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498519.023906:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885611392:12345-0@lo:400:kworker.0 Request processed in 32us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498519.023911:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1789498519.024305:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498519.024311:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498519.024314:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498519.024344:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885611392:0@lo:400:kworker.0 00000100:00100000:3.0:1789498519.024356:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885611520:0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.024460:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885611776:0@lo:400:kworker.0 00000100:00100000:2.0:1789498519.024471:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885611136:0@lo:400:kworker.0 00000100:00100000:3.0:1789498519.112635:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498519.113140:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864629888 00000100:00100000:1.0:1789498519.113151:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864629888 00000100:00100000:1.0:1789498519.113238:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:1.0:1789498519.113247:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:11340:x1876424864629888:12345-192.168.201.20@tcp:101:lctl.0 00010000:00010000:1.0:1789498519.113279:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498519.113301:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1ea expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.113365:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.113392:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.113405:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498519.113446:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789498519.113450:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498519.113471:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.113493:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18b3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ea expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.113510:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ea expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.113519:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:1.0:1789498519.113521:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498519.113525:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddec00, rc 0) 00000100:00100000:1.0:1789498519.113598:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:11340:x1876424864629888:12345-192.168.201.20@tcp:101:lctl.0 Request processed in 352us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498519.113605:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00080000:3.0:1789498519.114166:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498519.214524:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498519.216007:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864630016 00000100:00100000:0.0:1789498519.216026:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864630016 00000100:00100000:0.0:1789498519.216162:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 141 00000100:00100000:0.0:1789498519.216173:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:11346:x1876424864630016:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498519.216194:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498519.216234:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1f1 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216313:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216342:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216354:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216369:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216375:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216382:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216512:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216520:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216527:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498519.216556:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789498519.216559:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498519.216577:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216588:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216604:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216610:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216616:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498519.216621:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216628:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216640:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:0.0:1789498519.216643:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498519.216648:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216654:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216680:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216686:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216691:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216696:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498519.216705:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216711:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216718:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98ea84ebff00) 00010000:00010000:0.0:1789498519.216720:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498519.216723:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216741:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc18b58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216770:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18b4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f1 expref: 16 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216782:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f1 expref: 15 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.216789:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:0.0:1789498519.216791:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789498519.216794:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5c00, rc 0) 00000100:00100000:0.0:1789498519.216869:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:11346:x1876424864630016:12345-192.168.201.20@tcp:101:bash.0 Request processed in 698us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498519.216876:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 141 00000100:00100000:0.0:1789498519.222125:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.222501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864630272 00000100:00100000:2.0:1789498519.222511:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864630272 00000100:00100000:2.0:1789498519.222575:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 142 00000100:00100000:2.0:1789498519.222584:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+15:11346:x1876424864630272:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498519.222604:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498519.222625:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18b66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1f8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.222777:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.222792:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.222803:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.222815:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.222822:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.222828:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789498519.223673:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789498519.225449:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225469:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225481:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225521:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225528:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225534:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225540:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498519.225544:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225552:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225562:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498519.225565:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498519.225570:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.225590:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18b6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498519.225616:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2df8472 reply state 000000006cb1f151 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498519.225625:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789498519.226548:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18b66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.226570:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.226578:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:2.0:1789498519.226580:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498519.226583:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25400, rc 0) 00000100:00100000:2.0:1789498519.226714:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11346:x1876424864630272:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4130us (4628us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789498519.226724:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 142 00010000:00010000:0.0:1789498519.238129:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.238163:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.238171:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.238178:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498519.238183:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.238192:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.238227:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98eaa1d46f00) 00010000:00010000:0.0:1789498519.238231:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498519.238236:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.238242:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18b74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498519.239925:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498519.240054:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864630400 00000100:00100000:3.0:1789498519.240064:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864630400 00000100:00100000:3.0:1789498519.240156:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:3.0:1789498519.240166:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2355:x1876424864630400:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498519.240183:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498519.240210:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a1ff expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498519.240240:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789498519.240259:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1789498519.240263:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498519.240272:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.240319:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.240333:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20da800, rc 0) 00000100:00100000:3.0:1789498519.240382:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864630400:12345-192.168.201.20@tcp:101:bash.0 Request processed in 217us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498519.240388:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00080000:0.0:1789498519.241978:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498519.246459:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498519.246604:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864630528 00000100:00100000:0.0:1789498519.246614:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864630528 00000100:00100000:0.0:1789498519.246679:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:0.0:1789498519.246689:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:11346:x1876424864630528:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498519.246707:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498519.246737:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a206 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.246784:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.246794:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498519.246798:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498519.246804:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.246836:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.246850:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 7 pid: 6704 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498519.246874:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1876424885611904:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498519.246960:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498519.250267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498519.250509:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864630656 00000100:00100000:3.0:1789498519.250518:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864630656 00010000:00010000:3.0:1789498519.250554:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 8 pid: 6704 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498519.250592:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:3.0:1789498519.250601:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864630656:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498519.250615:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498519.250639:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 8 pid: 6704 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.250653:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 8 pid: 6704 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.250689:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498519.250693:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498519.250718:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.250740:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.250780:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498519.250795:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876424885612032:192.168.201.20@tcp:105: 00000100:00100000:3.0:1789498519.251121:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea857413c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789498519.251683:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097f2ce5b/0x3a6cb1946bc18b89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ff expref: 8 pid: 6704 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498519.251700:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1876424885611904:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498519.251748:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.251759:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5a00, rc 0) 00000100:00100000:1.0:1789498519.251796:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:11346:x1876424864630528:12345-192.168.201.20@tcp:101:bash.0 Request processed in 5109us (5346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498519.251804:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:3.0:1789498519.254584:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876424885612032:192.168.201.20@tcp:105: 00010000:00010000:3.0:1789498519.254607:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498519.255180:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864630656:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 4059us (4400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498519.255242:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:0.0:1789498519.258050:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.258206:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864630912 00000100:00100000:2.0:1789498519.258216:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864630912 00000100:00100000:2.0:1789498519.258264:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:2.0:1789498519.258273:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:11346:x1876424864630912:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:2.0:1789498519.258625:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11346:x1876424864630912:12345-192.168.201.20@tcp:35:bash.0 Request processed in 352us (582us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789498519.258633:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:3.0:1789498519.376288:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498519.376563:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864631168 00000100:00100000:0.0:1789498519.376576:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864631168 00000100:00100000:0.0:1789498519.376663:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:0.0:1789498519.376676:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11356:x1876424864631168:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498519.376838:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498519.376872:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a20d expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498519.377032:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789498519.385914:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a20d expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.385952:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:0.0:1789498519.385956:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789498519.385967:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc18b97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a20d expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.385992:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4e00, rc 0) 00000100:00100000:0.0:1789498519.386138:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:11356:x1876424864631168:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 9463us (9865us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1789498519.386150:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:1.0:1789498519.390415:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.390578:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864631424 00000100:00100000:2.0:1789498519.390609:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864631424 00000100:00100000:2.0:1789498519.390839:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1789498519.390853:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:11356:x1876424864631424:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498519.391223:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:11356:x1876424864631424:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 364us (813us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789498519.391232:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00010000:00010000:1.0:1789498519.467367:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498519.493862:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.494085:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864631552 00000100:00100000:2.0:1789498519.494160:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864631552 00000100:00100000:2.0:1789498519.494709:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:2.0:1789498519.494733:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:11362:x1876424864631552:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498519.494771:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498519.494802:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18ba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a214 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.494902:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.494919:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.494934:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498519.494985:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789498519.494989:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498519.495013:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.495046:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18ba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a214 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.495138:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a214 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.495149:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498519.495152:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498519.495157:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25c00, rc 0) 00000100:00100000:2.0:1789498519.495246:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:11362:x1876424864631552:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 526us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498519.495253:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:3.0:1789498519.501849:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.501973:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864631808 00000100:00100000:2.0:1789498519.501984:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864631808 00000100:00100000:2.0:1789498519.502123:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 145 00000100:00100000:2.0:1789498519.502135:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:11362:x1876424864631808:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498519.502165:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498519.502191:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18bb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a21b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.502346:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18bba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.502363:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.502377:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498519.502390:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789498519.502585:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18bb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a21b expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.502606:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18bba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a21b expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.502615:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:2.0:1789498519.502749:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498519.502754:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25200, rc 0) 00000100:00100000:2.0:1789498519.502837:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:11362:x1876424864631808:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 700us (999us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789498519.502845:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 145 00000100:00100000:0.0:1789498519.511599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498519.511652:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498519.511681:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864632064 00000100:00100000:1.0:1789498519.511701:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864632064 00000100:00100000:3.0:1789498519.511786:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864632192 00000100:00100000:1.0:1789498519.511790:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 146 00000100:00100000:3.0:1789498519.511791:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864632192 00000100:00100000:1.0:1789498519.511802:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11362:x1876424864632064:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498519.511829:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789498519.511839:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:3.0:1789498519.511846:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2355:x1876424864632192:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498519.511855:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a222 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.511860:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498519.511885:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18bba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a21b expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.511928:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:3.0:1789498519.511935:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498519.511981:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18bcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.511998:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498519.512005:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:2355:x1876424864632192:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 160us (353us total) trans 0 rc 0/0 00010000:00010000:1.0:1789498519.512011:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498519.512012:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000004:00200000:1.0:1789498519.512025:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789498519.512222:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a222 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.512256:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18bcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a222 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.512265:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:1.0:1789498519.512268:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789498519.512270:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf000, rc 0) 00000100:00100000:1.0:1789498519.512312:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11362:x1876424864632064:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 512us (724us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789498519.512319:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 146 00000100:00100000:0.0:1789498519.523650:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498519.524047:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864632320 00000100:00100000:3.0:1789498519.524062:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864632320 00000100:00100000:3.0:1789498519.524183:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:3.0:1789498519.524196:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864632320:12345-192.168.201.20@tcp:1:lfs.0 00010000:00010000:3.0:1789498519.524910:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.524938:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.524947:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498519.524952:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498519.524958:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.525004:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.525022:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 6 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498519.525063:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6704:1876424885612160:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498519.525215:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea857413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498519.527071:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6704:1876424885612160:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498519.527217:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498519.531889:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885612288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498519.531993:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498519.532087:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885612288 00000100:00100000:3.0:1789498519.532115:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885612288 00000100:00100000:3.0:1789498519.532172:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789498519.532179:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885612288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498519.532234:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498519.532398:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885612416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498519.532427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498519.532471:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885612416 00000100:00100000:2.0:1789498519.532475:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885612416 00000100:00100000:2.0:1789498519.532500:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789498519.532505:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885612416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498519.532526:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498519.532551:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885612416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498519.532556:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789498519.532598:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885612416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498519.534593:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885612288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2403us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498519.534609:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789498519.534845:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885612288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498519.537578:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498519.537707:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864632448 00000100:00100000:3.0:1789498519.537755:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864632448 00002000:00100000:3.0:1789498519.537821:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98eaba8f7100 x1876424864632448/t0(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:550/0 lens 504/0 e 0 to 0 dl 1789498530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789498519.537835:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eaba8f7100 with x1876424864632448 ext(0->12) 00010000:00010000:3.0:1789498519.537847:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 7 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.537868:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 7 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498519.537878:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98eaba8f7100 00000100:00100000:3.0:1789498519.537914:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1789498519.537925:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864632448:12345-192.168.201.20@tcp:4:lfs.0 00000100:00100000:3.0:1789498519.538644:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2355:x1876424864632448:12345-192.168.201.20@tcp:4:lfs.0 Request processed in 716us (1076us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789498519.538655:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00002000:00100000:3.0:1789498519.538664:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98eaba8f7100 x1876424864632448/t4294967305(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:550/0 lens 504/448 e 0 to 0 dl 1789498530 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789498519.538673:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eaba8f7100 with x1876424864632448 ext(0->12) 00010000:00010000:3.0:1789498519.538680:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 9 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.538696:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 9 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498519.538704:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98eaba8f7100 00000100:00100000:3.0:1789498519.549231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498519.551364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864632576 00000100:00100000:0.0:1789498519.551384:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864632576 00010000:00010000:0.0:1789498519.551448:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 9 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498519.551590:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:0.0:1789498519.551599:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2356:x1876424864632576:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498519.551625:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789498519.551654:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789498519.551657:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789498518 00002000:00010000:0.0:1789498519.551658:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789498519 00002000:00010000:0.0:1789498519.551660:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789498518 00010000:00010000:0.0:1789498519.551665:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 9 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.551678:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 9 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.551710:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc18b90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a206 expref: 9 pid: 6702 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.551744:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498519.551749:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498519.551757:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.551770:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.551815:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498519.551962:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.551971:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.551998:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.552005:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.552020:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.552025:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498519.552029:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.552037:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.552046:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.552051:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045ff655b/0x3a6cb1946bc18bdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498519.552160:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864632576:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 562us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498519.552168:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:1.0:1789498519.553856:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864632320:12345-192.168.201.20@tcp:1:lfs.0 Request processed in 29651us (30209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498519.553868:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1789498519.567981:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498519.568118:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864632832 00000100:00100000:3.0:1789498519.568134:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864632832 00000100:00100000:3.0:1789498519.568204:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:3.0:1789498519.568216:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5954c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11362:x1876424864632832:12345-192.168.201.20@tcp:35:lfs.0 00000004:00010000:3.0:1789498519.568430:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18bcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a222 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498519.568774:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789498519.568811:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789498519.569971:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1789498519.570074:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.570143:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.570154:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.570206:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.570235:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 28 pid: 5846 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498519.570249:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876424885612544:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498519.570384:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84e76780 going to sleep for 11 seconds 00000100:00100000:3.0:1789498519.574922:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876424885612544:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498519.574958:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498519.576343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498519.576449:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864632960 00000100:00100000:1.0:1789498519.576461:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864632960 00010000:00010000:1.0:1789498519.576514:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 29 pid: 5846 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498519.576550:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:1.0:1789498519.576574:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:2356:x1876424864632960:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498519.576589:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498519.576595:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 29 pid: 5846 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.576607:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 29 pid: 5846 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.576630:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18b7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f8 expref: 29 pid: 5846 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.576650:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:1.0:1789498519.576657:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.576669:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.576678:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.576716:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498519.576797:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:2356:x1876424864632960:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 224us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498519.576804:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00010000:00010000:0.0:1789498519.577577:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.577587:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498519.577793:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789498519.578002:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789498519.578148:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876424885612672:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789498519.578202:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498519.578237:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498519.578453:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885612672 00000100:00100000:1.0:1789498519.578463:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885612672 00000100:00100000:1.0:1789498519.578515:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498519.578523:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876424885612672:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789498519.578622:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876424885612672:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498519.578629:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498519.578825:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876424885612672:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789498519.579877:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1789498519.579990:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba131c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876424885612800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789498519.580063:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498519.580127:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498519.580235:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885612800 00000100:00100000:1.0:1789498519.580247:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885612800 00000100:00100000:1.0:1789498519.580302:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789498519.580310:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876424885612800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789498519.580579:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876424885612800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 269us (516us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789498519.580586:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498519.581217:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba131c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876424885612800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789498519.581336:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1789498519.581406:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.581419:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.581445:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.581451:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498519.581457:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.581466:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.581485:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:0.0:1789498519.581489:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789498519.581495:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.581501:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18be4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789498519.581773:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789498519.581915:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789498519.581929:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 419345838211ns, next at 420345835841ns, rc = 0 00000001:00080000:0.0:1789498519.581937:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1789498519.581973:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46200) 00010000:00010000:0.0:1789498519.581977:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789498519.581985:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18bcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a222 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498519.582126:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5954c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:11362:x1876424864632832:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 13912us (14164us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1789498519.582143:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000020:00080000:0.0:1789498519.582148:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789498519.587173:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.590048:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864633088 00000100:00100000:2.0:1789498519.590069:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864633088 00000100:00100000:2.0:1789498519.590988:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 147 00000100:00100000:2.0:1789498519.591005:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:11362:x1876424864633088:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498519.591058:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498519.591121:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18beb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a229 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.591216:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18beb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a229 expref: 32 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.591235:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18beb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a229 expref: 32 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.591260:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498519.591264:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498519.591269:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25200, rc 0) 00000100:00100000:2.0:1789498519.591375:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11362:x1876424864633088:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 375us (4216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498519.591383:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 147 00000100:00100000:2.0:1789498519.594767:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498519.594886:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864633344 00000100:00100000:0.0:1789498519.594901:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864633344 00000100:00100000:0.0:1789498519.594968:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:0.0:1789498519.594980:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11362:x1876424864633344:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1789498519.595669:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:11362:x1876424864633344:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 689us (914us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789498519.595680:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498519.686916:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498519.687826:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864633600 00000100:00100000:1.0:1789498519.687843:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864633600 00000100:00100000:1.0:1789498519.687979:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 148 00000100:00100000:1.0:1789498519.687991:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:11372:x1876424864633600:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498519.688026:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498519.688054:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a230 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498519.688202:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789498519.688400:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18bf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a230 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.688418:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:1.0:1789498519.688422:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498519.688495:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a230 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498519.688539:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde400, rc 0) 00000100:00100000:1.0:1789498519.688633:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11372:x1876424864633600:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 643us (1731us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789498519.688642:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 148 00000100:00100000:1.0:1789498519.693074:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.693337:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864633728 00000100:00100000:2.0:1789498519.693352:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864633728 00000100:00100000:2.0:1789498519.693477:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 149 00000100:00100000:2.0:1789498519.693491:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11372:x1876424864633728:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:2.0:1789498519.693593:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693625:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693641:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693687:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693695:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693702:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693838:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693848:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693855:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498519.693916:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693931:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693939:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693946:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693952:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498519.693957:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693974:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.693987:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498519.693991:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498519.693997:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694003:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694020:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694026:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694032:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694037:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498519.694040:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694046:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694052:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98eaa1d46e00) 00010000:00010000:2.0:1789498519.694054:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498519.694056:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694068:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694081:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694084:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694124:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694128:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498519.694130:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694133:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694138:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498519.694139:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498519.694142:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498519.694146:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498519.694229:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11372:x1876424864633728:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 742us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498519.694235:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 149 00000100:00100000:3.0:1789498519.696470:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498519.696562:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864633984 00000100:00100000:1.0:1789498519.696575:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864633984 00000100:00100000:1.0:1789498519.696651:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:1.0:1789498519.696662:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11372:x1876424864633984:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498519.696975:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:11372:x1876424864633984:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 315us (518us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789498519.696980:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:3.0:1789498519.740989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.743071:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864634240 00000100:00100000:2.0:1789498519.743108:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864634240 00000100:00100000:3.0:1789498519.743664:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 150 00000100:00100000:3.0:1789498519.743678:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:11375:x1876424864634240:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498519.743715:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498519.743754:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18c15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a237 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.743900:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.743919:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.743933:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.743951:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.743957:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.743964:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744399:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744410:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744418:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498519.744431:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789498519.744763:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744772:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744789:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744796:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498519.744802:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744812:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744827:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:3.0:1789498519.744831:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498519.744837:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744897:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744920:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744927:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744934:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744940:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498519.744943:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744960:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744969:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea9108c200) 00010000:00010000:3.0:1789498519.744972:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498519.744975:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.744981:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.745042:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18c15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.745059:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498519.745067:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:3.0:1789498519.745069:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498519.745072:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20da800, rc 0) 00000100:00100000:3.0:1789498519.745580:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:11375:x1876424864634240:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1902us (8090us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789498519.745591:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 150 00000100:00100000:1.0:1789498519.750072:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498519.750379:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864634368 00000100:00100000:0.0:1789498519.750393:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864634368 00000100:00100000:0.0:1789498519.750633:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 151 00000100:00100000:0.0:1789498519.750647:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:11375:x1876424864634368:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:0.0:1789498519.750750:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750773:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750788:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750825:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750833:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750864:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750870:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498519.750875:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750885:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750899:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:0.0:1789498519.750902:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789498519.750908:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498519.750915:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc18c38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498519.751054:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:11375:x1876424864634368:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 410us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498519.751062:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 151 00000100:00100000:3.0:1789498519.753848:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498519.753996:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864634624 00000100:00100000:2.0:1789498519.754010:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864634624 00000100:00100000:2.0:1789498519.754078:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:2.0:1789498519.754109:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:11375:x1876424864634624:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498519.754926:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:11375:x1876424864634624:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 834us (1089us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789498519.754936:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:3.0:1789498520.129053:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498520.129479:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864634880 00000100:00100000:1.0:1789498520.129496:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864634880 00000100:00100000:1.0:1789498520.129584:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 152 00000100:00100000:1.0:1789498520.129595:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:11406:x1876424864634880:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:1.0:1789498520.129619:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498520.129641:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18c3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a23e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.129781:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.129806:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.129833:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498520.129846:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789498520.130482:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18c3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a23e expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.130504:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a23e expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.130513:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:1.0:1789498520.130516:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498520.130519:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde400, rc 0) 00000100:00100000:1.0:1789498520.130589:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:11406:x1876424864634880:12345-192.168.201.20@tcp:101:cat.0 Request processed in 996us (1552us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789498520.130597:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 152 00000100:00100000:1.0:1789498520.137509:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498520.137626:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498520.137760:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864635264 00000100:00100000:3.0:1789498520.137771:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864635264 00000100:00100000:3.0:1789498520.137851:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:3.0:1789498520.137877:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85662c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:2355:x1876424864635264:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498520.137894:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498520.137919:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a23e expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498520.137937:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:3.0:1789498520.137943:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498520.138001:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85662c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+39:2355:x1876424864635264:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 128us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498520.138008:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:0.0:1789498520.138890:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864635136 00000100:00100000:0.0:1789498520.138899:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864635136 00000100:00100000:0.0:1789498520.138940:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:0.0:1789498520.138956:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+39:11406:x1876424864635136:12345-192.168.201.20@tcp:35:cat.0 00000100:00100000:0.0:1789498520.139417:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:11406:x1876424864635136:12345-192.168.201.20@tcp:35:cat.0 Request processed in 467us (1916us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789498520.139425:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:1.0:1789498520.278486:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498520.280050:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864635520 00000100:00100000:2.0:1789498520.280065:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864635520 00000100:00100000:2.0:1789498520.280187:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 153 00000100:00100000:2.0:1789498520.280199:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:11412:x1876424864635520:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1789498520.280226:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498520.280230:0:7250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789498520.280261:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a214 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.280281:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498520.280287:0:7250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498520.280312:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a245 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.280418:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.280433:0:7250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.280461:0:7250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.280494:0:7250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.280881:0:7250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 40 pid: 5845 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498520.280902:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885612928:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498520.281020:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea89b4b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789498520.286840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498520.286851:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885612928:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498520.286900:0:7250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498520.287253:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864635648 00000100:00100000:1.0:1789498520.287264:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864635648 00010000:00010000:1.0:1789498520.287330:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 41 pid: 5845 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498520.287369:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:1.0:1789498520.287379:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+41:2356:x1876424864635648:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498520.287393:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498520.287416:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 41 pid: 5845 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.287430:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 41 pid: 5845 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.287452:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a237 expref: 41 pid: 5845 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.287472:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:1.0:1789498520.287477:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.287487:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.287494:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.287523:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498520.287589:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:2356:x1876424864635648:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 211us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498520.287596:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00010000:00010000:2.0:1789498520.287787:0:7250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.287796:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498520.287816:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789498520.287976:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 41 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.287991:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 40 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.287998:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498520.288001:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498520.288012:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24000, rc 0) 00000100:00100000:2.0:1789498520.288051:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:11412:x1876424864635520:12345-192.168.201.20@tcp:101:dd.0 Request processed in 7854us (9576us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789498520.288059:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 153 00000100:00100000:2.0:1789498520.294039:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498520.294147:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864635904 00000100:00100000:1.0:1789498520.294158:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864635904 00000100:00100000:1.0:1789498520.294219:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:1.0:1789498520.294230:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:11412:x1876424864635904:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:1.0:1789498520.295731:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.296804:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498520.296825:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789498520.296917:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1789498520.296959:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8e57b36 reply state 000000008c92f263 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498520.296968:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789498520.297116:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:11412:x1876424864635904:12345-192.168.201.20@tcp:36:dd.0 Request processed in 2860us (3058us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789498520.297125:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 154 00000020:00080000:1.0:1789498520.297131:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498520.305629:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.305649:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.305657:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.305663:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498520.305669:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.305676:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.305693:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498520.305696:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498520.305702:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.305719:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18c69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.492039:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498520.595513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498520.595603:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864636032 00000100:00100000:2.0:1789498520.595614:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864636032 00000100:00100000:2.0:1789498520.595685:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00100000:2.0:1789498520.595696:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+42:11426:x1876424864636032:12345-192.168.201.20@tcp:101:stat.0 00010000:00010000:2.0:1789498520.595735:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498520.595760:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18c70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a24c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.595843:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.595859:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.595870:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.595886:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.595893:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.595900:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.595991:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.596002:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 43 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.596012:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.596051:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 43 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.599231:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 43 pid: 7250 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498520.599254:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885613056:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498520.599390:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea89b4b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789498520.607218:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498520.607247:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885613056:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498520.607281:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498520.607367:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864636288 00000100:00100000:0.0:1789498520.607376:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864636288 00000100:00100000:0.0:1789498520.607445:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:0.0:1789498520.607455:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+44:5598:x1876424864636288:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789498520.607802:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:5598:x1876424864636288:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 347us (596us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789498520.607809:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:1.0:1789498520.639588:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498520.639697:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864636416 00000100:00100000:0.0:1789498520.639719:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864636416 00010000:00010000:0.0:1789498520.639761:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 45 pid: 7250 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498520.639802:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:0.0:1789498520.639812:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:2355:x1876424864636416:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498520.639827:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498520.639834:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 45 pid: 7250 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.639848:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 45 pid: 7250 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.639871:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24000/0x3a6cb1946bc18c5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a245 expref: 45 pid: 7250 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.639888:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:0.0:1789498520.639893:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.639919:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.639927:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.639960:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498520.640017:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+44:2355:x1876424864636416:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 206us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498520.640025:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00010000:00010000:2.0:1789498520.640407:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640415:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498520.640471:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789498520.640476:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498520.640498:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640511:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640520:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640539:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640545:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640551:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498520.640555:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640563:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640572:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498520.640575:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498520.640580:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640586:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24e00/0x3a6cb1946bc18c77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640596:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640602:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640608:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640612:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498520.640621:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640627:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640634:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98eaa1d46e00) 00010000:00010000:2.0:1789498520.640637:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498520.640640:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640646:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25400/0x3a6cb1946bc18c7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640683:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25c00/0x3a6cb1946bc18c70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a24c expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640696:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a24c expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.640714:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498520.640716:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498520.640719:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24600, rc 0) 00000100:00100000:2.0:1789498520.640749:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:11426:x1876424864636032:12345-192.168.201.20@tcp:101:stat.0 Request processed in 45056us (45246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498520.640755:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00100000:3.0:1789498520.718245:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498520.718472:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864636672 00000100:00100000:0.0:1789498520.718483:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864636672 00000100:00100000:0.0:1789498520.718544:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 156 00000100:00100000:0.0:1789498520.718555:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:11432:x1876424864636672:12345-192.168.201.20@tcp:36:truncate.0 00010000:00010000:0.0:1789498520.718610:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498520.718637:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24600/0x3a6cb1946bc18c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a24c expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.718657:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:0.0:1789498520.718661:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498520.718931:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.718946:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.718958:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498520.719034:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1789498520.719074:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6e68e90 reply state 000000008191bdf6 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498520.719084:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498520.719351:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:11432:x1876424864636672:12345-192.168.201.20@tcp:36:truncate.0 Request processed in 796us (1115us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789498520.719359:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 156 00000020:00080000:0.0:1789498520.719364:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789498520.721695:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.721721:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.721729:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.721735:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498520.721740:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.721748:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.721763:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:0.0:1789498520.721766:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498520.721771:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498520.721777:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18c8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498520.967664:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498520.968148:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864636800 00000100:00100000:2.0:1789498520.968163:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864636800 00000100:00100000:2.0:1789498520.968246:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 157 00000100:00100000:2.0:1789498520.968258:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+44:11446:x1876424864636800:12345-192.168.201.20@tcp:101:stat.0 00010000:00010000:2.0:1789498520.968317:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498520.968346:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc18c93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a253 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.968852:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.968889:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.968913:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.968937:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.968945:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.968952:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969134:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969150:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969157:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498520.969197:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789498520.969207:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498520.969236:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969248:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969260:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969267:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969274:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969279:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498520.969288:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969296:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969307:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498520.969315:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498520.969319:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969325:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc18c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969344:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969360:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.969365:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.970308:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498520.970312:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.970319:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.970330:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98eaa1d46e00) 00010000:00010000:2.0:1789498520.970332:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498520.970335:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.970341:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc18ca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.971200:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc18c93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 46 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.971224:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 45 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498520.971232:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498520.971235:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498520.971252:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098200, rc 0) 00000100:00100000:2.0:1789498520.971339:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:11446:x1876424864636800:12345-192.168.201.20@tcp:101:stat.0 Request processed in 3082us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498520.971348:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 157 00000100:00100000:1.0:1789498521.215888:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498521.216200:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864637056 00000100:00100000:2.0:1789498521.216216:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864637056 00000100:00100000:2.0:1789498521.216286:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 158 00000100:00100000:2.0:1789498521.216298:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+45:11456:x1876424864637056:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498521.216319:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498521.216340:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18caf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a25a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498521.216450:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000100:00080000:0.0:1789498521.217549:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498521.220939:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18caf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a25a expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.220968:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:3.0:1789498521.220972:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498521.220980:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18caf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a25a expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.220999:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099200, rc 0) 00000100:00100000:3.0:1789498521.221191:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+46:11456:x1876424864637056:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 4884us (5311us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1789498521.221231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 158 00000001:00080000:1.0:1789498521.228520:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:1.0:1789498521.229042:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789498521.229310:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e9852e7d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789498521.229324:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98eabb26a900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e9852e7f00 00000020:00080000:1.0:1789498521.229329:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98eabb26a700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e98645f000 00000020:00080000:2.0:1789498521.230934:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789498521.231119:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789498521.231167:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885613184:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789498521.231337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498521.231400:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885613184 00000100:00100000:3.0:1789498521.231410:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885613184 00000100:00080000:2.0:1789498521.231450:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498521.231477:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789498521.231488:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885613184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789498521.231517:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1789498521.231558:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa99496, atime: 0x6aa99497, ctime: 0x6aa99496, blocks: 0xb 00010000:00010000:3.0:1789498521.231568:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.231585:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1789498521.231590:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498521.231598:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.231616:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.231626:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.231633:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.231658:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498521.232130:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498521.232139:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.232150:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498521.232162:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.232173:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.232192:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.232199:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18cbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.232223:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498521.232226:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498521.232228:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498521.232233:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876424885613184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 745us (894us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789498521.232248:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1789498521.232332:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eabb4a7100/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789498521.232340:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885613184:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789498521.244399:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1789498521.244422:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1789498521.413071:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498521.413229:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864637312 00000100:00100000:1.0:1789498521.413240:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864637312 00000100:00100000:1.0:1789498521.414249:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:1.0:1789498521.414270:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5952050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:11456:x1876424864637312:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498521.416552:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5952050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11456:x1876424864637312:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 2282us (3480us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789498521.416566:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00010000:00010000:2.0:1789498521.515473:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498521.539567:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498521.540150:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864637568 00000100:00100000:0.0:1789498521.540165:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864637568 00000100:00100000:0.0:1789498521.540246:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 159 00000100:00100000:0.0:1789498521.540271:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11462:x1876424864637568:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498521.540306:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498521.540335:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18cc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a261 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.540491:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.540514:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 19 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.540527:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.540582:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 19 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.540600:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 19 pid: 7250 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498521.540618:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885613312:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498521.540921:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498521.546324:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498521.546857:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885613312:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498521.546896:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498521.547059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864637696 00000100:00100000:1.0:1789498521.547075:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864637696 00010000:00010000:1.0:1789498521.547170:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 20 pid: 7250 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498521.547214:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:1.0:1789498521.547242:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:2355:x1876424864637696:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498521.547274:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498521.547284:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 20 pid: 7250 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.547300:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 20 pid: 7250 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.547327:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc18ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a253 expref: 20 pid: 7250 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.547347:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:1.0:1789498521.547353:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.547364:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.547374:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.547403:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498521.547448:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.547460:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498521.547477:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:2355:x1876424864637696:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 235us (1164us total) trans 0 rc 0/0 00000004:00200000:0.0:1789498521.547485:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:1.0:1789498521.547487:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00010000:00010000:0.0:1789498521.547672:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18cc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.547706:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.547715:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:0.0:1789498521.547717:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789498521.547721:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5000, rc 0) 00000100:00100000:0.0:1789498521.547800:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:11462:x1876424864637568:12345-192.168.201.20@tcp:101:bash.0 Request processed in 7545us (8256us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789498521.547810:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 159 00000100:00100000:1.0:1789498521.554487:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498521.554673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864637952 00000100:00100000:3.0:1789498521.554683:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864637952 00000100:00100000:3.0:1789498521.554748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 160 00000100:00100000:3.0:1789498521.554758:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:11462:x1876424864637952:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:3.0:1789498521.555773:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.555792:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.555804:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498521.555867:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789498521.555901:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046225f05 reply state 00000000319fd0c5 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498521.555911:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498521.556009:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:11462:x1876424864637952:12345-192.168.201.20@tcp:36:bash.0 Request processed in 1251us (1529us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789498521.557755:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 160 00000020:00080000:3.0:1789498521.557763:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498521.559953:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.559970:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.559978:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.559997:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498521.560002:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.560010:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.560327:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498521.560331:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498521.560337:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.560344:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18cd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498521.568411:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498521.568950:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864638080 00000100:00100000:2.0:1789498521.568960:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864638080 00000100:00100000:2.0:1789498521.569025:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 161 00000100:00100000:2.0:1789498521.569035:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:11462:x1876424864638080:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498521.569059:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498521.569077:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099e00/0x3a6cb1946bc18ce0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a268 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.569190:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.569205:0:7250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.569229:0:7250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.569260:0:7250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.569283:0:7250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 22 pid: 5847 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498521.569297:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885613440:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498521.569371:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498521.582064:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885613440:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498521.582144:0:7250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498521.588788:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498521.590220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864638208 00000100:00100000:3.0:1789498521.590236:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864638208 00010000:00010000:3.0:1789498521.590285:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 23 pid: 5847 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498521.590327:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1789498521.590336:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:2356:x1876424864638208:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498521.590352:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498521.590359:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 23 pid: 5847 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.590374:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 23 pid: 5847 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.590396:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc18ccb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a261 expref: 23 pid: 5847 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.590410:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:3.0:1789498521.590416:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.590436:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.593759:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.593887:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498521.593986:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:2356:x1876424864638208:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 3645us (5202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498521.593997:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00010000:00010000:2.0:1789498521.605619:0:7250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.605637:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498521.605708:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789498521.605714:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498521.605737:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.605776:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099e00/0x3a6cb1946bc18ce0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a268 expref: 22 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.605798:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a268 expref: 21 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.605828:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498521.605831:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498521.605835:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099600, rc 0) 00000100:00100000:2.0:1789498521.606075:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:11462:x1876424864638080:12345-192.168.201.20@tcp:101:bash.0 Request processed in 37039us (37670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498521.606084:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 161 00000100:00100000:1.0:1789498521.627471:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498521.627591:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864638464 00000100:00100000:0.0:1789498521.627602:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864638464 00000100:00100000:0.0:1789498521.627659:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:0.0:1789498521.627668:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:11462:x1876424864638464:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:0.0:1789498521.627922:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:11462:x1876424864638464:12345-192.168.201.20@tcp:35:bash.0 Request processed in 255us (460us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789498521.627929:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:3.0:1789498521.769404:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498521.779957:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864638720 00000100:00100000:0.0:1789498521.780044:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864638720 00000100:00100000:1.0:1789498521.780430:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 162 00000100:00100000:1.0:1789498521.780443:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:11472:x1876424864638720:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498521.780481:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498521.780520:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18cee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a26f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498521.780648:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789498521.781322:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18cee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a26f expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.781342:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:1.0:1789498521.781345:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498521.781352:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18cee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a26f expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.781370:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddee00, rc 0) 00000100:00100000:1.0:1789498521.785793:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:11472:x1876424864638720:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 5334us (16386us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789498521.785811:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 162 00000100:00100000:3.0:1789498521.797671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498521.798192:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864638848 00000100:00100000:0.0:1789498521.798209:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864638848 00000100:00100000:0.0:1789498521.798289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 163 00000100:00100000:0.0:1789498521.798302:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:11472:x1876424864638848:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:0.0:1789498521.798647:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.798669:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.798696:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.798715:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.798724:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.798731:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799501:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799514:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799532:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498521.799591:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799606:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799614:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799623:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799629:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498521.799634:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799643:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799657:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:0.0:1789498521.799661:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498521.799667:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799674:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18cfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799700:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799713:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799719:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799725:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498521.799728:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799736:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799744:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea84ebff00) 00010000:00010000:0.0:1789498521.799747:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498521.799751:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799757:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799773:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799780:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799786:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799791:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498521.799802:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799809:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799818:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:0.0:1789498521.799820:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498521.799823:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.799829:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18d0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498521.800194:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:11472:x1876424864638848:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 1890us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498521.800204:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 163 00000100:00100000:2.0:1789498521.803942:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498521.804412:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864639104 00000100:00100000:0.0:1789498521.804438:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864639104 00000100:00100000:0.0:1789498521.804555:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:0.0:1789498521.804569:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:11472:x1876424864639104:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1789498521.804915:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11472:x1876424864639104:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 348us (986us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789498521.804924:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:3.0:1789498521.833761:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498521.833898:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864639360 00000100:00100000:1.0:1789498521.833980:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864639360 00000100:00100000:1.0:1789498521.834060:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:1.0:1789498521.834073:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11475:x1876424864639360:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498521.834149:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498521.834175:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18d11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a276 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.834645:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.834663:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.834677:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.834706:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.834714:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.834722:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835588:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835603:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835612:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498521.835625:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789498521.835769:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835778:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835793:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835800:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498521.835805:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835814:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835829:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:1.0:1789498521.835833:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498521.835838:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835845:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835862:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835870:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835877:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.835883:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498521.835886:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.836413:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.836428:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea930e1500) 00010000:00010000:1.0:1789498521.836430:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498521.836435:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.836442:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.836513:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18d11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a276 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.836529:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a276 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.836538:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:1.0:1789498521.836540:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498521.836543:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde600, rc 0) 00000100:00100000:1.0:1789498521.836644:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11475:x1876424864639360:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 2572us (2898us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789498521.836655:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:3.0:1789498521.840521:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498521.840575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498521.840635:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864639488 00000100:00100000:2.0:1789498521.840651:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864639488 00000100:00100000:1.0:1789498521.840657:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864639616 00000100:00100000:1.0:1789498521.840663:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864639616 00000100:00100000:2.0:1789498521.840738:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:2.0:1789498521.840750:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:11475:x1876424864639488:12345-192.168.201.20@tcp:54:lfs.0 00000100:00100000:1.0:1789498521.840784:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1789498521.840796:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:2356:x1876424864639616:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498521.840833:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498521.840839:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.840864:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a276 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.840872:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.840888:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498521.840889:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498521.840898:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498521.840930:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.840939:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.840946:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.840967:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498521.840973:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.840981:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498521.840986:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:2356:x1876424864639616:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 191us (407us total) trans 0 rc 0/0 00010000:00010000:2.0:1789498521.840997:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00000100:00100000:1.0:1789498521.840998:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00010000:00010000:2.0:1789498521.841004:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498521.841008:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498521.841015:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc18d34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498521.841056:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+25:11475:x1876424864639488:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 308us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498521.841064:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:2.0:1789498521.861499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498521.861858:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864639872 00000100:00100000:1.0:1789498521.861872:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864639872 00000100:00100000:1.0:1789498521.861950:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:1.0:1789498521.861961:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+25:11475:x1876424864639872:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498521.862341:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11475:x1876424864639872:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 381us (856us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789498521.862351:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:1.0:1789498521.949913:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498521.950213:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864640128 00000100:00100000:3.0:1789498521.950229:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864640128 00000100:00100000:3.0:1789498521.950325:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 166 00000100:00100000:3.0:1789498521.950340:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11493:x1876424864640128:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:3.0:1789498521.950375:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498521.950404:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18d3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a27d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.950542:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18d42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.950561:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.950576:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498521.950589:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789498521.950780:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18d3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a27d expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.951023:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a27d expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498521.951052:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:3.0:1789498521.951056:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789498521.951060:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498521.951209:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11493:x1876424864640128:12345-192.168.201.20@tcp:101:cat.0 Request processed in 872us (1426us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789498521.951218:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 166 00000100:00100000:3.0:1789498521.986526:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498521.987040:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864640256 00000100:00100000:0.0:1789498521.987056:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864640256 00000100:00100000:0.0:1789498521.987339:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 167 00000100:00100000:0.0:1789498521.987354:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11494:x1876424864640256:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498521.987387:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498521.987429:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a284 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.987518:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18d57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.987535:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.987551:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498521.987607:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789498521.987611:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498521.987633:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.987665:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc18d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a284 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.987700:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a284 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498521.987710:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:0.0:1789498521.987713:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498521.987719:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4200, rc 0) 00000100:00100000:0.0:1789498521.987933:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11494:x1876424864640256:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 583us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498521.987942:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 167 00000100:00100000:2.0:1789498521.999176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498521.999308:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864640640 00000100:00100000:1.0:1789498521.999322:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864640640 00000100:00100000:1.0:1789498521.999400:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:1.0:1789498521.999412:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11494:x1876424864640640:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498522.000583:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:11494:x1876424864640640:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 1166us (1413us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789498522.000595:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:1.0:1789498522.014141:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498522.018399:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864640768 00000100:00100000:3.0:1789498522.018421:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864640768 00000100:00100000:2.0:1789498522.018730:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1789498522.018745:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:11494:x1876424864640768:12345-192.168.201.20@tcp:103:lfs.0 00010000:00010000:2.0:1789498522.018765:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789498522.018800:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18ce7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a268 expref: 30 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.018909:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a27d expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.019033:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25200/0x3a6cb1946bc18beb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a229 expref: 28 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.019044:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498522.019057:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498522.019470:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:11494:x1876424864640768:12345-192.168.201.20@tcp:103:lfs.0 Request processed in 727us (5388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498522.019481:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1789498522.028052:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.028297:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864640896 00000100:00100000:1.0:1789498522.028313:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864640896 00000100:00100000:1.0:1789498522.028394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 168 00000100:00100000:1.0:1789498522.028406:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:11494:x1876424864640896:12345-192.168.201.20@tcp:58:lfs.0 00010000:00010000:1.0:1789498522.028595:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.028618:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.028634:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498522.029194:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789498522.029329:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:11494:x1876424864640896:12345-192.168.201.20@tcp:58:lfs.0 Request processed in 922us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498522.029338:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 168 00000100:00100000:1.0:1789498522.095408:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498522.096995:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864641024 00000100:00100000:2.0:1789498522.097018:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864641024 00000100:00100000:2.0:1789498522.097182:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:2.0:1789498522.097195:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:11496:x1876424864641024:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498522.097229:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498522.097259:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a28b expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097347:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097364:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097379:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097396:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097422:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097429:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097814:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097835:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097845:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498522.097899:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789498522.097905:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498522.097931:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097946:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097957:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097964:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097973:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.097992:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498522.097998:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098008:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098022:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498522.098026:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498522.098032:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098039:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098055:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098062:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098068:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098073:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498522.098076:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098082:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098167:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98eaa1d46000) 00010000:00010000:2.0:1789498522.098170:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498522.098173:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098179:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098216:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 29 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098231:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 28 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.098238:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1500) 00010000:00010000:2.0:1789498522.098240:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498522.098243:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098800, rc 0) 00000100:00100000:2.0:1789498522.098348:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11496:x1876424864641024:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1156us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498522.098357:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 169 00000040:00080000:3.0:1789498522.411434:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789498522.411454:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498522.411512:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789498522.411522:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789498522.411650:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeed500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885613568:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789498522.411758:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea884e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789498522.441677:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.441712:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864641152 00000100:00100000:1.0:1789498522.441722:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864641152 00000100:00100000:1.0:1789498522.441777:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 170 00000100:00100000:1.0:1789498522.441787:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11507:x1876424864641152:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789498522.441817:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789498522.441922:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11507:x1876424864641152:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 136us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498522.441929:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 170 00000100:00100000:0.0:1789498522.442714:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeed500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885613568:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789498522.448001:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498522.448132:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864641280 00000100:00100000:2.0:1789498522.448148:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864641280 00000100:00100000:2.0:1789498522.448221:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 171 00000100:00100000:2.0:1789498522.448231:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11507:x1876424864641280:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789498522.448307:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.448322:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.448352:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.448368:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.448375:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.448381:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.448408:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.448416:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.448851:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498522.449035:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789498522.449040:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498522.449055:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449067:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449073:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449080:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449115:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498522.449120:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449128:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449139:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:1.0:1789498522.449142:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498522.449146:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449152:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc18d81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449166:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449173:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449187:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449192:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498522.449195:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449201:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449210:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff98eaa1d46000) 00010000:00010000:1.0:1789498522.449212:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498522.449215:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449220:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099a00/0x3a6cb1946bc18d88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449234:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449240:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449246:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449251:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498522.449254:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449269:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449278:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1500) 00010000:00010000:1.0:1789498522.449280:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498522.449283:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.449289:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc18d8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498522.449369:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11507:x1876424864641280:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 Request processed in 1138us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498522.449377:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 171 00000100:00100000:1.0:1789498522.454889:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498522.455142:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864641536 00000100:00100000:2.0:1789498522.455153:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864641536 00000100:00100000:2.0:1789498522.455208:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 172 00000100:00100000:2.0:1789498522.455218:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11507:x1876424864641536:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498522.455238:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498522.455259:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098000/0x3a6cb1946bc18d96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a292 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455370:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455394:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455406:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498522.455420:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789498522.455528:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455535:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455541:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455547:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498522.455551:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455558:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455569:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1500) 00010000:00010000:2.0:1789498522.455572:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498522.455589:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455595:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455632:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098000/0x3a6cb1946bc18d96 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a292 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455650:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:2.0:1789498522.455652:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498522.455656:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098000/0x3a6cb1946bc18d96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a292 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.455666:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098000, rc 0) 00000100:00100000:2.0:1789498522.455948:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11507:x1876424864641536:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 731us (1067us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789498522.455964:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 172 00000100:00100000:2.0:1789498522.467907:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.467978:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864641664 00000100:00100000:1.0:1789498522.467988:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864641664 00000100:00100000:1.0:1789498522.468070:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 173 00000100:00100000:1.0:1789498522.468113:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11507:x1876424864641664:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789498522.468150:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789498522.468319:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11507:x1876424864641664:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 230us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498522.468328:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 173 00000100:00100000:3.0:1789498522.470921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498522.471067:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864641920 00000100:00100000:2.0:1789498522.471076:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864641920 00000100:00100000:2.0:1789498522.471166:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:2.0:1789498522.471176:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11507:x1876424864641920:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498522.471194:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498522.471197:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789498522.471256:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18d57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a284 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.471272:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498522.471277:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498522.471290:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098000/0x3a6cb1946bc18dab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a299 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789498522.474296:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789498522.475571:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.475662:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.475684:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.475760:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098000/0x3a6cb1946bc18dab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a299 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.475780:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a299 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.476378:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98eaa1d46e00) 00010000:00010000:2.0:1789498522.476383:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498522.476388:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099400, rc 0) 00000100:00100000:2.0:1789498522.476724:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:11507:x1876424864641920:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 5545us (5806us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789498522.476734:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:2.0:1789498522.485017:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.485200:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864642176 00000100:00100000:1.0:1789498522.485211:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864642176 00000100:00100000:1.0:1789498522.485270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 175 00000100:00100000:1.0:1789498522.485280:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:11507:x1876424864642176:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789498522.485349:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498522.485376:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a299 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485394:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98eaa1d46e00) 00010000:00010000:1.0:1789498522.485403:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498522.485424:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485592:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485604:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485620:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485627:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485633:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485855:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485863:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485870:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485882:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498522.485887:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485895:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485904:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:1.0:1789498522.485907:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498522.485911:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485916:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18dc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485927:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485932:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485938:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485943:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498522.485946:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485952:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485970:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x27355389 (ffff98ea930e1b00) 00010000:00010000:1.0:1789498522.485972:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498522.485976:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.485981:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18dc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x27355389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498522.486522:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11507:x1876424864642176:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 1239us (1528us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789498522.486531:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 175 00000100:00100000:1.0:1789498522.496594:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498522.496789:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864642304 00000100:00100000:3.0:1789498522.496800:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864642304 00000100:00100000:3.0:1789498522.496877:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 176 00000100:00100000:3.0:1789498522.496887:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11507:x1876424864642304:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498522.496908:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498522.496930:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18dce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2a0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498522.496969:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498522.496999:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498522.497022:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498522.497339:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498522.497358:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498522.497366:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:3.0:1789498522.497368:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789498522.497372:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498522.497472:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:11507:x1876424864642304:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 585us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498522.497479:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 176 00000100:00100000:0.0:1789498522.515804:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498522.515973:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864642560 00000100:00100000:3.0:1789498522.515986:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864642560 00000100:00100000:3.0:1789498522.516055:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 177 00000100:00100000:0.0:1789498522.516356:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+30:11507:x1876424864642560:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789498522.516644:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498522.516662:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498522.516683:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498522.517361:0:7250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789498522.517373:0:7250:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 422281281802ns, next at 423281278958ns, rc = 0 00000004:00010000:0.0:1789498522.517651:0:7250:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c586cf8 reply state 0000000045cf1816 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498522.517662:0:7250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498522.517826:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11507:x1876424864642560:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 1529us (2030us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789498522.517834:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 177 00010000:00010000:0.0:1789498522.521233:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498522.521252:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498522.521260:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498522.521267:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498522.521290:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498522.521298:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498522.521315:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:0.0:1789498522.521319:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789498522.521324:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498522.521330:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc18ddc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498522.522394:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498522.522868:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864642688 00000100:00100000:2.0:1789498522.522884:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864642688 00000100:00100000:2.0:1789498522.522958:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 178 00000100:00100000:2.0:1789498522.522968:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:11507:x1876424864642688:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498522.523004:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498522.523025:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2a7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.523143:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.523157:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.523178:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:2.0:1789498522.523182:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498522.523186:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098600, rc 0) 00000100:00100000:2.0:1789498522.523255:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11507:x1876424864642688:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 288us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498522.523263:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 178 00000100:00100000:2.0:1789498522.530466:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.532742:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864642816 00000100:00100000:1.0:1789498522.532758:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864642816 00000100:00100000:1.0:1789498522.532845:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:1.0:1789498522.532856:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864642816:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789498522.533252:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864642816:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 397us (2795us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789498522.533260:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00080000:2.0:1789498522.533700:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498522.538695:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498522.544875:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864643072 00000100:00100000:0.0:1789498522.544892:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864643072 00000100:00100000:0.0:1789498522.544957:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1789498522.544969:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11507:x1876424864643072:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789498522.545255:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:11507:x1876424864643072:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 287us (6570us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789498522.545264:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00010000:00010000:1.0:1789498522.546163:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498522.556402:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498522.557048:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864643328 00000100:00100000:3.0:1789498522.557059:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864643328 00000100:00100000:3.0:1789498522.557157:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 179 00000100:00100000:3.0:1789498522.557168:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:11507:x1876424864643328:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789498522.557307:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:11507:x1876424864643328:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 139us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498522.557334:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 179 00000100:00100000:3.0:1789498522.567275:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498522.569777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864643456 00000100:00100000:2.0:1789498522.569793:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864643456 00000100:00100000:2.0:1789498522.569870:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:2.0:1789498522.569881:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+33:11507:x1876424864643456:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498522.569902:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498522.569924:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098000/0x3a6cb1946bc18dea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.570023:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18df1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.570037:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.570055:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498522.570121:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498522.570141:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.570169:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098000/0x3a6cb1946bc18dea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ae expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.570188:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ae expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.570196:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:2.0:1789498522.570198:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789498522.570203:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099400, rc 0) 00000100:00100000:2.0:1789498522.570261:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11507:x1876424864643456:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 382us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498522.570269:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:0.0:1789498522.583584:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.586890:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864643584 00000100:00100000:1.0:1789498522.586910:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864643584 00000100:00100000:1.0:1789498522.586991:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:1.0:1789498522.587002:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864643584:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498522.587022:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498522.587058:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2b5 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498522.587087:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9949a, blocks: 0x1 00010000:00010000:1.0:1789498522.587133:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789498522.587137:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498522.587146:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.587163:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.587176:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf600, rc 0) 00000100:00100000:1.0:1789498522.587241:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864643584:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 242us (3668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498522.587248:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:0.0:1789498522.596717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498522.596873:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864643840 00000100:00100000:3.0:1789498522.596883:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864643840 00000100:00100000:3.0:1789498522.596950:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 181 00000100:00100000:3.0:1789498522.596961:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11507:x1876424864643840:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789498522.597079:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11507:x1876424864643840:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498522.597087:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 181 00000100:00100000:0.0:1789498522.606760:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498522.607907:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864643968 00000100:00100000:2.0:1789498522.607920:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864643968 00000100:00100000:2.0:1789498522.607993:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1789498522.608005:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:11507:x1876424864643968:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498522.608024:0:10445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498522.608043:0:10445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2bc expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.608116:0:10445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 9 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.608127:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498522.608132:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498522.608138:0:10445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 9 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.608175:0:10445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 9 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.608189:0:10445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 9 pid: 6702 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498522.608205:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83734e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10445:1876424885613696:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498522.608299:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789498522.620310:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83734e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10445:1876424885613696:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498522.620348:0:10445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 9 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.620369:0:10445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098000, rc 0) 00000100:00100000:2.0:1789498522.620447:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:11507:x1876424864643968:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 12438us (13687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498522.620457:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1789498522.621025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.621454:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864644096 00000100:00100000:1.0:1789498522.621466:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864644096 00010000:00010000:1.0:1789498522.621505:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 9 pid: 6702 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498522.621559:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:1.0:1789498522.621568:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85661850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2355:x1876424864644096:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498522.621584:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498522.621610:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 9 pid: 6702 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.621638:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 9 pid: 6702 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.621663:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061bca213/0x3a6cb1946bc18df8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2b5 expref: 9 pid: 6702 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.621687:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498522.621692:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498522.621700:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 8 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.621711:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 8 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.621746:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 8 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498522.621760:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1876424885613824:192.168.201.20@tcp:105: 00000100:00100000:1.0:1789498522.621832:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcf780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498522.630656:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498522.630855:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1876424885613824:192.168.201.20@tcp:105: 00010000:00010000:3.0:1789498522.630880:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498522.630939:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85661850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864644096:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 9372us (9914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498522.630950:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:2.0:1789498522.633762:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864644224 00000100:00100000:2.0:1789498522.633778:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864644224 00002000:00100000:2.0:1789498522.633838:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98e986cf8e00 x1876424864644224/t0(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:553/0 lens 504/0 e 0 to 0 dl 1789498533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789498522.633850:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e986cf8e00 with x1876424864644224 ext(0->8) 00002000:00010000:2.0:1789498522.633858:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98e986cf8e00 00000100:00100000:3.0:1789498522.633910:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498522.633923:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864644224:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789498522.634714:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2355:x1876424864644224:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 Request processed in 792us (4065us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789498522.634724:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00002000:00100000:3.0:1789498522.634734:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98e986cf8e00 x1876424864644224/t4294967314(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:553/0 lens 504/448 e 0 to 0 dl 1789498533 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789498522.634743:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e986cf8e00 with x1876424864644224 ext(0->8) 00002000:00010000:3.0:1789498522.634747:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98e986cf8e00 00000100:00100000:1.0:1789498522.644832:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498522.645116:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864644352 00000100:00100000:2.0:1789498522.645126:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864644352 00000100:00100000:2.0:1789498522.645183:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 182 00000100:00100000:2.0:1789498522.645197:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11507:x1876424864644352:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789498522.770888:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1789498522.770908:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789498522.770968:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789498522.771012:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789498522.771030:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789498522.771728:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885613952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789498522.771830:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498522.771874:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885613952 00000100:00100000:1.0:1789498522.771886:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885613952 00000100:00100000:1.0:1789498522.771963:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789498522.771973:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885613952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789498522.772176:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789498522.772179:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789498522 00002000:00010000:1.0:1789498522.772182:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789498522.772184:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789498522 -> 1789498522 00002000:00010000:1.0:1789498522.772186:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789498522.772271:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876424885613952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (441us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789498522.772278:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789498522.772301:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498522.772572:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11507:x1876424864644352:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 Request processed in 127378us (127754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498522.772580:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 182 00000004:00080000:3.0:1789498522.774546:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eabaeedf80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789498522.774562:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885613952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789498522.779282:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.779449:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864644480 00000100:00100000:1.0:1789498522.779462:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864644480 00000100:00100000:1.0:1789498522.779853:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:1.0:1789498522.779865:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2356:x1876424864644480:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789498522.930324:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2356:x1876424864644480:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 Request processed in 150450us (151050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498522.930341:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 55 00000001:00080000:1.0:1789498522.930384:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1789498522.930398:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1789498522.930404:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1789498522.957832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498522.959306:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864644736 00000100:00100000:1.0:1789498522.959317:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864644736 00000100:00100000:1.0:1789498522.959405:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 183 00000100:00100000:1.0:1789498522.959434:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11507:x1876424864644736:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789498522.959488:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498522.959513:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099400/0x3a6cb1946bc18df1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ae expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.959527:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:1.0:1789498522.959531:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498522.959569:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.959580:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498522.959586:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498522.959840:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b947b0b3 reply state 0000000079a077cd transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498522.959847:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789498522.959936:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:11507:x1876424864644736:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 507us (2113us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789498522.959942:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 183 00010000:00010000:2.0:1789498522.963488:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.963505:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.963513:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.963519:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498522.963524:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.963531:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.963560:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:2.0:1789498522.963564:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498522.963570:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498522.963577:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18e06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498522.991186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498522.991223:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864644864 00000100:00100000:0.0:1789498522.991234:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864644864 00000100:00100000:0.0:1789498522.991283:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:0.0:1789498522.991293:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864644864:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789498522.991557:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789498522.991560:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789498522 -> 1789498521 00002000:00010000:0.0:1789498522.991576:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789498519 00002000:00010000:0.0:1789498522.991579:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789498522 -> 1789498521 00002000:00010000:0.0:1789498522.991582:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789498522.991891:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864644864:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 598us (712us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789498522.991899:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:3.0:1789498523.002741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498523.002969:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864645120 00000100:00100000:0.0:1789498523.002980:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864645120 00000100:00100000:0.0:1789498523.003060:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 184 00000100:00100000:0.0:1789498523.003072:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11507:x1876424864645120:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789498523.003168:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.003185:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.003196:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.003237:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.003259:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 18 pid: 5845 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498523.003274:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabae8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885614080:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498523.003355:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababefcc0 going to sleep for 11 seconds 00000100:00080000:2.0:1789498523.004085:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498523.007815:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabae8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885614080:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498523.007845:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498523.008030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498523.008124:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864645248 00000100:00100000:2.0:1789498523.008133:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864645248 00010000:00010000:2.0:1789498523.008173:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 19 pid: 5845 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498523.008210:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:2.0:1789498523.008219:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:2356:x1876424864645248:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498523.008232:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498523.008239:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 19 pid: 5845 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.008251:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 19 pid: 5845 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.008274:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18dd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a0 expref: 19 pid: 5845 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.008290:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:2.0:1789498523.008295:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.008312:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.008320:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.008344:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498523.008391:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:2356:x1876424864645248:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 173us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498523.008398:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00010000:00010000:0.0:1789498523.008993:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.009003:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.009041:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.009048:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.009055:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.009060:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498523.009065:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.009072:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.009080:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:0.0:1789498523.009118:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789498523.009124:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.009130:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc18e0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498523.009192:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:11507:x1876424864645120:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 Request processed in 6123us (6464us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789498523.009201:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 184 00000100:00100000:0.0:1789498523.027444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498523.027484:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498523.027520:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.027645:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864645376 00000100:00100000:3.0:1789498523.027655:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864645376 00000100:00100000:3.0:1789498523.027711:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864645632 00000100:00100000:3.0:1789498523.027714:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864645632 00000100:00100000:3.0:1789498523.027749:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:3.0:1789498523.027758:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864645632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498523.027834:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2357:x1876424864645632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498523.027841:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:3.0:1789498523.027859:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:3.0:1789498523.027866:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864645376:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789498523.027897:0:10445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.027919:0:10445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 8 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.027927:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498523.027932:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498523.027944:0:10445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.027978:0:10445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 8 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.027992:0:10445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 8 pid: 10445 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498523.028006:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10445:1876424885614208:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498523.028054:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea8864acc0 going to sleep for 11 seconds 00000100:00080000:3.0:1789498523.028074:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498523.028354:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864645504 00000100:00100000:2.0:1789498523.028359:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864645504 00000100:00100000:2.0:1789498523.028395:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 300 00000100:00100000:2.0:1789498523.028403:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864645504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498523.028433:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864645504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498523.028439:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 300 00000100:00100000:0.0:1789498523.028521:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.035597:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10445:1876424885614208:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498523.035638:0:10445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498523.036600:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864645760 00000100:00100000:2.0:1789498523.036609:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864645760 00000100:00100000:3.0:1789498523.036748:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:3.0:1789498523.036757:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864645760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498523.036834:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2357:x1876424864645760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (8314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498523.036842:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00080000:2.0:1789498523.037356:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498523.047919:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.048007:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864645888 00000100:00100000:3.0:1789498523.048018:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864645888 00010000:00010000:3.0:1789498523.048058:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 9 pid: 10445 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498523.049839:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:0.0:1789498523.049869:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2355:x1876424864645888:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498523.049906:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498523.049966:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 9 pid: 10445 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.049984:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 9 pid: 10445 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.050008:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc18dff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2bc expref: 9 pid: 10445 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.050026:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498523.050042:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498523.050047:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.050057:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.050139:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498523.050200:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864645888:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 349us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498523.050208:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00010000:00010000:3.0:1789498523.050277:0:10445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.050287:0:10445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.050313:0:10445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.050322:0:10445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.050329:0:10445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.050336:0:10445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498523.050340:0:10445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.050350:0:10445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.050362:0:10445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.050380:0:10445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f62cce60/0x3a6cb1946bc18e14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498523.050426:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864645376:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 Request processed in 22560us (22992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498523.050434:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:0.0:1789498523.066877:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.066958:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864646144 00000100:00100000:3.0:1789498523.066968:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864646144 00000100:00100000:3.0:1789498523.067025:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 185 00000100:00100000:3.0:1789498523.067035:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+17:11507:x1876424864646144:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789498523.067157:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.067176:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.067189:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.067396:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.067408:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.067417:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.067464:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.067477:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 18 pid: 5846 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498523.067491:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885614336:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498523.067572:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea8864acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498523.080770:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498523.080908:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864646272 00000100:00100000:1.0:1789498523.080919:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864646272 00010000:00010000:1.0:1789498523.080978:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 19 pid: 5846 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498523.081028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:1.0:1789498523.081079:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:2356:x1876424864646272:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498523.081129:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498523.081137:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 19 pid: 5846 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.081162:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 19 pid: 5846 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.081187:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:1.0:1789498523.081192:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.081201:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.081209:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.081240:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498523.081293:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:2356:x1876424864646272:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 233us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498523.081300:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00010000:00010000:3.0:1789498523.081529:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098600/0x3a6cb1946bc18de3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2a7 expref: 18 pid: 5846 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498523.081547:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885614336:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498523.081581:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.081590:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.081596:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498523.082142:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789498523.082707:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789498523.082764:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789498523.082897:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876424885614464:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789498523.082983:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498523.083032:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498523.083106:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885614464 00000100:00100000:3.0:1789498523.083113:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885614464 00000100:00100000:3.0:1789498523.088079:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498523.088111:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876424885614464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789498523.088369:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876424885614464:12345-0@lo:1000:mdt00_001.0 Request processed in 277us (5385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498523.088377:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789498523.090409:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1789498523.090419:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eabaeedf80, transno 4294967315 00000100:00100000:1.0:1789498523.090468:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeec000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876424885614464:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789498523.091027:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1789498523.091138:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e986cfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876424885614592:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789498523.091207:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498523.091462:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcf840 going to sleep for 11 seconds 00000100:00100000:0.0:1789498523.091528:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885614592 00000100:00100000:0.0:1789498523.091535:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885614592 00000100:00100000:0.0:1789498523.091595:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789498523.091604:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876424885614592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789498523.091812:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876424885614592:12345-0@lo:1000:mdt00_001.0 Request processed in 209us (605us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789498523.091820:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789498523.091857:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e986cfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876424885614592:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789498523.091894:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.091903:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092252:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092265:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498523.092270:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092279:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092294:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:0.0:1789498523.092297:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498523.092302:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092308:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e22 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092339:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092347:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092352:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092357:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498523.092360:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092366:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092384:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1500) 00010000:00010000:0.0:1789498523.092386:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498523.092389:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092395:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18d5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092416:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092431:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 21 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092440:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092466:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 21 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.092480:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 21 pid: 7250 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498523.092493:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885614720:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498523.092566:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababefa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498523.105547:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885614720:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498523.105583:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498523.110061:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498523.110323:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864646400 00000100:00100000:1.0:1789498523.110334:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864646400 00010000:00010000:1.0:1789498523.110375:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 22 pid: 7250 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498523.110421:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:1.0:1789498523.110432:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:2357:x1876424864646400:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498523.110447:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498523.110454:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 22 pid: 7250 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.110467:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 22 pid: 7250 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.110489:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098800/0x3a6cb1946bc18d7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a28b expref: 22 pid: 7250 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.110504:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1500) 00010000:00010000:1.0:1789498523.110510:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.110521:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.110540:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.110574:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498523.110616:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110625:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498523.110630:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:2357:x1876424864646400:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 201us (579us total) trans 0 rc 0/0 00010000:00010000:2.0:1789498523.110637:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498523.110637:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00010000:00010000:2.0:1789498523.110652:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110670:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110677:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498523.110681:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110689:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110698:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1500) 00010000:00010000:2.0:1789498523.110701:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498523.110704:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110710:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e29 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110722:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110728:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110734:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110739:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498523.110748:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110754:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110763:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1500) 00010000:00010000:2.0:1789498523.110765:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789498523.110768:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.110774:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498523.110988:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:11507:x1876424864646144:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 43954us (44121us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789498523.110996:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 185 00000020:00080000:2.0:1789498523.111000:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789498523.113537:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789498523.113546:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498523.114024:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789498523.114036:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789498523.117211:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498523.117318:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864646656 00000100:00100000:1.0:1789498523.117329:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864646656 00000100:00100000:1.0:1789498523.117393:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:1.0:1789498523.117415:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5951450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:11507:x1876424864646656:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789498523.118171:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789498523.118268:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1789498523.120941:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.120963:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.120976:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.120984:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.120991:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.120998:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.121038:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498523.121415:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498523.121422:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.121429:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfc00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498523.121433:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.121441:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.121453:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98ea930e1900) 00010000:00010000:3.0:1789498523.121456:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789498523.121461:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.121467:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18e30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.121489:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498523.121491:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498523.121493:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498523.122362:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5951450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:11507:x1876424864646656:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 4944us (5154us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789498523.122372:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00000020:00080000:1.0:1789498523.122378:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1789498523.306705:0:12470:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498523.306714:0:12470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498523.306778:0:12470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789498523.306784:0:12470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789498523.520782:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498523.520828:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864646912 00000100:00100000:0.0:1789498523.520839:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864646912 00000100:00100000:0.0:1789498523.520889:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 186 00000100:00100000:0.0:1789498523.520897:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:11517:x1876424864646912:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498523.520923:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498523.520943:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18e37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2c3 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.521047:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.521060:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.521073:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498523.521083:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789498523.521225:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc18e37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2c3 expref: 25 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.521241:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2c3 expref: 24 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.521250:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:0.0:1789498523.521252:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789498523.521256:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5800, rc 0) 00000100:00100000:0.0:1789498523.521312:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11517:x1876424864646912:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 415us (539us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789498523.521328:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 186 00000100:00100000:3.0:1789498523.526860:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498523.527319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864647040 00000100:00100000:1.0:1789498523.527330:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864647040 00000100:00100000:1.0:1789498523.527391:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 187 00000100:00100000:1.0:1789498523.527401:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11517:x1876424864647040:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:1.0:1789498523.527473:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.527489:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.527501:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.527516:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.527523:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.527529:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528830:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528856:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528865:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498523.528917:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528930:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528937:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528944:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528950:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498523.528955:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528962:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528974:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:1.0:1789498523.528977:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498523.528982:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.528988:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18e4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529009:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529015:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529021:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529026:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498523.529028:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529034:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529042:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea930e1600) 00010000:00010000:1.0:1789498523.529044:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498523.529047:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529052:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529067:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529073:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529079:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529107:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498523.529111:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529117:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529125:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1100) 00010000:00010000:1.0:1789498523.529127:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498523.529130:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.529135:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498523.529260:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11517:x1876424864647040:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 1857us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498523.529270:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 187 00010000:00010000:1.0:1789498523.565487:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498523.623279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.623316:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864647296 00000100:00100000:3.0:1789498523.623325:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864647296 00000100:00100000:3.0:1789498523.623391:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 188 00000100:00100000:3.0:1789498523.623402:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11521:x1876424864647296:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498523.623422:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498523.623441:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18e61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2ca expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623518:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623534:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623547:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623563:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623570:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623576:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623857:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623867:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.623875:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498523.625519:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789498523.630823:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630839:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630847:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630853:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498523.630857:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630864:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630879:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:3.0:1789498523.630882:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498523.630887:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630903:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18e68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630917:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630923:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630929:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630933:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498523.630936:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630942:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630950:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea9108ca00) 00010000:00010000:3.0:1789498523.630953:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498523.630956:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.630962:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.631019:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18e61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 27 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.631050:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 26 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.631064:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498523.631067:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498523.631069:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db400, rc 0) 00000100:00100000:3.0:1789498523.631155:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11521:x1876424864647296:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 7754us (7883us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789498523.631163:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 188 00000100:00100000:3.0:1789498523.638516:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498523.638827:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864647424 00000100:00100000:1.0:1789498523.638838:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864647424 00000100:00100000:1.0:1789498523.638899:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 189 00000100:00100000:1.0:1789498523.638909:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11521:x1876424864647424:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:1.0:1789498523.638969:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.638985:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.639014:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.639043:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.639049:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.639056:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.639061:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498523.639065:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.639071:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.639082:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:1.0:1789498523.639085:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498523.639106:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498523.639113:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc18e84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498523.640370:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11521:x1876424864647424:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 1458us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498523.640380:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 189 00000100:00100000:1.0:1789498523.652701:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.654116:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864647680 00000100:00100000:3.0:1789498523.654128:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864647680 00000100:00100000:3.0:1789498523.654184:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:3.0:1789498523.654195:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11521:x1876424864647680:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498523.654454:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:11521:x1876424864647680:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 260us (1764us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789498523.654462:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:0.0:1789498523.738002:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.738152:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864647936 00000100:00100000:3.0:1789498523.738163:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864647936 00000100:00100000:3.0:1789498523.738223:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00100000:3.0:1789498523.738233:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:11054:x1876424864647936:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498523.738257:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498523.738279:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18e8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2d1 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.738383:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.738413:0:7250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 28 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.738421:0:7250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.738467:0:7250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 28 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.738481:0:7250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 28 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498523.738496:0:7250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885614848:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498523.738604:0:7250:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498523.740845:0:7250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7250:1876424885614848:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498523.740872:0:7250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498523.741833:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498523.742153:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864648064 00000100:00100000:2.0:1789498523.742163:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864648064 00010000:00010000:2.0:1789498523.742202:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 29 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498523.742249:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:2.0:1789498523.742259:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:2355:x1876424864648064:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498523.742274:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498523.742282:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 29 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.742295:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 29 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.742329:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18e76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ca expref: 29 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.742346:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:2.0:1789498523.742350:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.742359:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.742365:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.742981:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498523.743057:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:2355:x1876424864648064:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 798us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498523.743067:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00010000:00010000:3.0:1789498523.746845:0:7250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.746862:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498523.746887:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789498523.747778:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18e8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 29 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.747812:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 28 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498523.747821:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:2.0:1789498523.747824:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498523.747827:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20db800, rc 0) 00000100:00100000:2.0:1789498523.747903:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11054:x1876424864647936:12345-192.168.201.20@tcp:101:bash.0 Request processed in 9670us (9909us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789498523.747929:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00100000:0.0:1789498523.753252:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.753384:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864648320 00000100:00100000:3.0:1789498523.753393:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864648320 00000100:00100000:3.0:1789498523.753454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 191 00000100:00100000:3.0:1789498523.753490:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11054:x1876424864648320:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:3.0:1789498523.753810:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.753829:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.753842:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498523.753900:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789498523.753926:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072c90bdb reply state 0000000093cd2709 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498523.753936:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789498523.754019:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1789498523.754160:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11054:x1876424864648320:12345-192.168.201.20@tcp:36:bash.0 Request processed in 672us (917us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789498523.754167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 191 00000020:00080000:3.0:1789498523.754172:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789498523.758305:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.758324:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.758331:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.758337:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dbc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498523.758342:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.758349:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.758366:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:0.0:1789498523.758369:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498523.758374:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498523.758380:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbc00/0x3a6cb1946bc18ea0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498523.759067:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.759353:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864648448 00000100:00100000:3.0:1789498523.759363:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864648448 00000100:00100000:3.0:1789498523.759426:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 192 00000100:00100000:3.0:1789498523.759436:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:11054:x1876424864648448:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498523.759468:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498523.759497:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2d8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.759568:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d8 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.759614:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d8 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.759636:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498523.759639:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498523.759641:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbe00, rc 0) 00000100:00100000:3.0:1789498523.759714:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11054:x1876424864648448:12345-192.168.201.20@tcp:101:bash.0 Request processed in 279us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498523.759722:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 192 00000100:00100000:1.0:1789498523.766363:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.766466:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864648576 00000100:00100000:3.0:1789498523.766476:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864648576 00000100:00100000:3.0:1789498523.766534:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:3.0:1789498523.766552:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:11054:x1876424864648576:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498523.766570:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498523.766591:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2df expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498523.766625:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa99499, atime: 0x6aa99497, ctime: 0x6aa99499, blocks: 0xb 00010000:00010000:3.0:1789498523.766657:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789498523.766662:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498523.766671:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.766688:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.766720:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac20dbc00, rc 0) 00000100:00100000:3.0:1789498523.766787:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:11054:x1876424864648576:12345-192.168.201.20@tcp:101:bash.0 Request processed in 244us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498523.766794:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:0.0:1789498523.772066:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498523.772307:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864648704 00000100:00100000:2.0:1789498523.772317:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864648704 00002000:00010000:2.0:1789498523.772360:0:6707:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789498523.772365:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eaba8c1180 with x1876424864648704 ext(0->18446744073709551615) 00002000:00010000:2.0:1789498523.772377:0:6707:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eaba8c1180. 00000100:00100000:2.0:1789498523.772418:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:2.0:1789498523.772428:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864648704:12345-192.168.201.20@tcp:10:bash.0 00002000:00010000:2.0:1789498523.772926:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789498523.772930:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789498521 -> 1789498523 00002000:00010000:2.0:1789498523.772933:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789498519 -> 1789498519 00002000:00010000:2.0:1789498523.772935:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789498521 -> 1789498523 00002000:00010000:2.0:1789498523.772937:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789498523.772992:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2355:x1876424864648704:12345-192.168.201.20@tcp:10:bash.0 Request processed in 565us (934us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789498523.773000:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00002000:00010000:2.0:1789498523.773004:0:6707:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789498523.773007:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eaba8c1180 with x1876424864648704 ext(0->18446744073709551615) 00002000:00010000:2.0:1789498523.773012:0:6707:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eaba8c1180. 00000100:00100000:1.0:1789498523.896985:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498523.897121:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864648832 00000100:00100000:3.0:1789498523.897140:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864648832 00000100:00100000:3.0:1789498523.897198:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 193 00000100:00100000:3.0:1789498523.897208:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11535:x1876424864648832:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:3.0:1789498523.897281:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897298:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897310:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897325:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897332:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897338:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897831:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897851:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897858:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498523.897904:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897915:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897921:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897927:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.897933:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20da800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498523.897937:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.899908:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.899927:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:3.0:1789498523.899931:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498523.899937:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.899955:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20da800/0x3a6cb1946bc18eb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.899994:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900001:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900007:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900013:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20db400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498523.900016:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900022:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900030:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea9108c200) 00010000:00010000:3.0:1789498523.900032:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498523.900036:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900041:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db400/0x3a6cb1946bc18ebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900063:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900069:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900075:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.900086:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498523.901203:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.901216:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.901227:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498523.901229:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498523.901233:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498523.901240:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498523.902986:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11535:x1876424864648832:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 5769us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498523.902999:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 193 00000100:00100000:1.0:1789498524.028324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.028585:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864649088 00000100:00100000:3.0:1789498524.028595:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864649088 00000100:00100000:3.0:1789498524.028666:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 194 00000100:00100000:3.0:1789498524.028676:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+32:11538:x1876424864649088:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498524.028696:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498524.028718:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18eca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2e6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.028788:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.028804:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.028816:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.028847:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.028854:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.028861:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029199:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc18edf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029209:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc18edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029215:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc18edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498524.029224:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789498524.029316:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029324:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029330:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029336:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498524.029340:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029370:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029383:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:3.0:1789498524.029386:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498524.029391:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029398:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18ed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029411:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029418:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029424:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029818:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498524.029822:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029830:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029838:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea9108c900) 00010000:00010000:3.0:1789498524.029841:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498524.029843:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029860:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029917:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18eca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2e6 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029932:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc18edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2e6 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.029939:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498524.029941:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789498524.029944:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90e00, rc 0) 00000100:00100000:3.0:1789498524.030007:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11538:x1876424864649088:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1332us (1692us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789498524.030015:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 194 00000100:00100000:0.0:1789498524.037580:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.037681:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864649216 00000100:00100000:1.0:1789498524.037690:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864649216 00000100:00100000:1.0:1789498524.037748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 195 00000100:00100000:1.0:1789498524.037757:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11538:x1876424864649216:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:1.0:1789498524.037825:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.037843:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 34 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.037853:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.037883:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 34 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.037897:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 34 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498524.037912:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba039180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885614976:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498524.038162:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcf600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498524.042705:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498524.042837:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864649472 00000100:00100000:2.0:1789498524.042851:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864649472 00000100:00100000:2.0:1789498524.042936:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:2.0:1789498524.042955:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:5598:x1876424864649472:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789498524.043707:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+36:5598:x1876424864649472:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 751us (1011us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789498524.043717:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:3.0:1789498524.043846:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba039180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885614976:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498524.043891:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498524.047963:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.048846:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864649600 00000100:00100000:1.0:1789498524.048873:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864649600 00010000:00010000:1.0:1789498524.048936:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 36 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498524.049061:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:1.0:1789498524.049074:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+36:2356:x1876424864649600:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498524.049112:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498524.049122:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 36 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.049147:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 36 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.049176:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db800/0x3a6cb1946bc18e92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d1 expref: 36 pid: 7250 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.049200:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:1.0:1789498524.049207:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.049453:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.049462:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.049501:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498524.049579:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:2356:x1876424864649600:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 507us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.049587:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00010000:00010000:3.0:1789498524.050223:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.050238:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.050299:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.050320:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.050328:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.050336:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498524.050341:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.050351:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.050364:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498524.050367:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498524.050372:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.050378:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18eed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498524.050465:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11538:x1876424864649216:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 12707us (12891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498524.050475:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 195 00000100:00100000:2.0:1789498524.058941:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.059328:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864649856 00000100:00100000:3.0:1789498524.059342:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864649856 00000100:00100000:3.0:1789498524.059415:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:3.0:1789498524.059427:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+34:11538:x1876424864649856:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498524.059768:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:11538:x1876424864649856:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 343us (843us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789498524.059790:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:1.0:1789498524.140170:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885615104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.140300:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498524.140368:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885615616:0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.140400:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498524.140432:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789498524.140438:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885615232:0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.140460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498524.140476:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885615744:0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.140501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498524.140536:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885615104 00000100:00100000:1.0:1789498524.140545:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885615104 00000100:00100000:1.0:1789498524.140608:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789498524.140617:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885615104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.140689:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3305:x1876424885615104:12345-0@lo:400:kworker.0 Request processed in 73us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.140696:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789498524.140732:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885615744 00000100:00100000:1.0:1789498524.140736:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885615744 00000100:00100000:1.0:1789498524.140773:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789498524.140779:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885615744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.140813:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885615744:12345-0@lo:400:kworker.0 Request processed in 34us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.140819:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1789498524.140840:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498524.140880:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885615744:0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.140889:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885615104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.140934:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885615616 00000100:00100000:1.0:1789498524.140938:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885615616 00000100:00100000:1.0:1789498524.140974:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885615232 00000100:00100000:1.0:1789498524.140977:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885615232 00000100:00100000:1.0:1789498524.140995:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789498524.141001:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885615616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.141037:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885615616:12345-0@lo:400:kworker.0 Request processed in 37us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.141271:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789498524.141285:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789498524.141292:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885615232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.141323:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885615232:12345-0@lo:400:kworker.0 Request processed in 31us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.141329:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1789498524.141344:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498524.141363:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885615232:0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.141374:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885615616:0@lo:400:kworker.0 00000100:00100000:0.0:1789498524.141489:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885615360:0@lo:400:kworker.0 00000100:00100000:0.0:1789498524.141528:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498524.141563:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498524.141570:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885615488:0@lo:400:kworker.0 00000100:00100000:0.0:1789498524.141595:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498524.141628:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885615488 00000100:00100000:0.0:1789498524.141632:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885615488 00000100:00100000:0.0:1789498524.141683:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789498524.141692:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885615488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498524.141732:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885615488:12345-0@lo:400:kworker.0 Request processed in 42us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498524.141739:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1789498524.141760:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498524.141776:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789498524.141782:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789498524.141802:0:3307:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98eabb4a7100 x1876424885613184/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789498537 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498524.141813:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885615488:0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.141879:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885615360 00000100:00100000:1.0:1789498524.141884:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885615360 00000100:00100000:1.0:1789498524.141923:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789498524.141929:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885615360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498524.141966:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885615360:12345-0@lo:400:kworker.0 Request processed in 37us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.141972:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1789498524.142392:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498524.142416:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885615360:0@lo:400:kworker.0 00000100:00100000:2.0:1789498524.200388:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.200626:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864650112 00000100:00100000:1.0:1789498524.200650:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864650112 00000100:00100000:1.0:1789498524.200750:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 196 00000100:00100000:1.0:1789498524.200762:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+35:11549:x1876424864650112:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:1.0:1789498524.200808:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498524.200837:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18ef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2ed expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.200946:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.200965:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.200979:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.200996:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201004:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201010:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201442:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201453:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201461:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498524.201487:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789498524.201625:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201633:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201653:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201659:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498524.201664:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201673:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201686:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:1.0:1789498524.201689:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498524.201695:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201702:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201717:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201724:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201742:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201747:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498524.201750:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201757:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201765:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea930e1100) 00010000:00010000:1.0:1789498524.201768:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498524.201771:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201777:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201839:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ed expref: 38 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201857:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ed expref: 37 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.201865:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:1.0:1789498524.201868:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498524.201871:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddee00, rc 0) 00000100:00100000:1.0:1789498524.201968:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:11549:x1876424864650112:12345-192.168.201.20@tcp:101:cat.0 Request processed in 1207us (1594us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789498524.201988:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 196 00000100:00100000:2.0:1789498524.219777:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.219931:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864650368 00000100:00100000:3.0:1789498524.219946:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864650368 00000100:00100000:3.0:1789498524.220012:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:3.0:1789498524.220024:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:11549:x1876424864650368:12345-192.168.201.20@tcp:35:cat.0 00000100:00100000:3.0:1789498524.220407:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:11549:x1876424864650368:12345-192.168.201.20@tcp:35:cat.0 Request processed in 384us (645us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789498524.220417:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:2.0:1789498524.265082:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.265469:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864650624 00000100:00100000:1.0:1789498524.265483:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864650624 00000100:00100000:1.0:1789498524.265560:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 197 00000100:00100000:1.0:1789498524.265572:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:11550:x1876424864650624:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1789498524.265665:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789498524.265703:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2ed expref: 38 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.265733:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc18edf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2e6 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.265750:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20dbe00/0x3a6cb1946bc18ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2d8 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.265765:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:1.0:1789498524.265781:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498524.266574:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.266595:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.266608:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.266628:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.266670:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.266678:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.267600:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.267615:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.267624:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498524.269510:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789498524.269529:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424033438291ns, next at 425033434117ns, rc = 0 00010000:00010000:0.0:1789498524.269651:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269671:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269699:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269710:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269717:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269723:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269831:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498524.269879:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269886:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269894:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269902:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498524.269907:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269915:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269930:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1600) 00010000:00010000:0.0:1789498524.269934:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789498524.269948:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269955:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf400/0x3a6cb1946bc18f25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269983:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269989:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269994:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.269999:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498524.270002:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.270008:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.270016:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:0.0:1789498524.270019:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498524.270022:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.270028:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc18f17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498524.270038:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae919a62 reply state 00000000355cd5a2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498524.270060:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498524.270248:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+37:11550:x1876424864650624:12345-192.168.201.20@tcp:36:rm.0 Request processed in 4670us (5175us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789498524.270634:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 197 00010000:00010000:3.0:1789498524.282831:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498524.282863:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.282881:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498524.282887:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.282901:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.282924:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98ea930e1600) 00010000:00010000:3.0:1789498524.282928:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789498524.282935:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.282942:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc18f2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.282972:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498524.282974:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498524.282995:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498524.283630:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.283652:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.283660:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.283666:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498524.283670:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.283678:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.283688:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea930e1100) 00010000:00010000:1.0:1789498524.283700:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498524.283705:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.283712:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498524.336597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.336735:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864650880 00000100:00100000:1.0:1789498524.336749:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864650880 00000100:00100000:1.0:1789498524.336837:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 198 00000100:00100000:1.0:1789498524.336848:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+36:11556:x1876424864650880:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498524.336879:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498524.336905:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2f4 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.337145:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.337164:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.337177:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.337192:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.337198:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.337204:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789498524.340203:0:7250:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789498524.340541:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340562:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340576:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340629:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340667:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340674:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340681:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498524.340762:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340785:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340801:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498524.340804:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498524.340811:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340817:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc18f3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498524.340836:0:7250:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bbe72dc reply state 000000000346b02d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498524.340848:0:7250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789498524.340900:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18f33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 39 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340918:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 38 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.340926:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98eaa1d46f00) 00010000:00010000:2.0:1789498524.340929:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498524.340932:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099200, rc 0) 00000100:00100000:2.0:1789498524.341193:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+39:11556:x1876424864650880:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4195us (4457us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789498524.341204:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 198 00000100:00100000:0.0:1789498524.346161:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.346271:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864651008 00000100:00100000:1.0:1789498524.346287:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864651008 00000100:00100000:1.0:1789498524.346362:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:1.0:1789498524.346373:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864651008:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498524.346397:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498524.346426:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a2fb expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498524.346461:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498524.346487:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789498524.346491:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498524.346502:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.346522:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.346536:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf400, rc 0) 00000100:00100000:1.0:1789498524.346609:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2356:x1876424864651008:12345-192.168.201.20@tcp:101:bash.0 Request processed in 238us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.346616:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00010000:00010000:2.0:1789498524.348599:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.348654:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.348662:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.348669:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498524.348674:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.348684:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.348784:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea930e1100) 00010000:00010000:2.0:1789498524.348787:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498524.348794:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.348801:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18f41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498524.352533:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498524.352654:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864651136 00000100:00100000:0.0:1789498524.352667:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864651136 00000100:00100000:0.0:1789498524.352746:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:0.0:1789498524.352758:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:11556:x1876424864651136:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498524.352783:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498524.352817:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a302 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.352859:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.352870:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498524.352874:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498524.352880:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.352921:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.352937:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 7 pid: 6704 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498524.352970:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1876424885615872:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498524.353139:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498524.356496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.356629:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1876424885615872:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498524.356690:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.356717:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5200, rc 0) 00000100:00100000:3.0:1789498524.356807:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:11556:x1876424864651136:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4051us (4288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498524.356817:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:2.0:1789498524.357169:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864651264 00000100:00100000:2.0:1789498524.357180:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864651264 00010000:00010000:2.0:1789498524.357225:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 7 pid: 6704 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498524.357275:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:2.0:1789498524.357286:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85662850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864651264:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498524.357303:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498524.357350:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 7 pid: 6704 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.357365:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 7 pid: 6704 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.357392:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc18f56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2fb expref: 7 pid: 6704 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.357410:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498524.357414:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498524.357424:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.357436:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.357482:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498524.357500:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1876424885616000:192.168.201.20@tcp:105: 00000100:00100000:2.0:1789498524.357563:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498524.361078:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1876424885616000:192.168.201.20@tcp:105: 00010000:00010000:2.0:1789498524.361320:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498524.361429:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85662850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864651264:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 4143us (4947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498524.361460:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:0.0:1789498524.364248:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.364728:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864651520 00000100:00100000:3.0:1789498524.364742:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864651520 00000100:00100000:3.0:1789498524.364933:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:3.0:1789498524.364947:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+38:11556:x1876424864651520:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:3.0:1789498524.365607:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+39:11556:x1876424864651520:12345-192.168.201.20@tcp:35:bash.0 Request processed in 661us (1372us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789498524.365617:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:1.0:1789498524.571302:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.571540:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864651648 00000100:00100000:3.0:1789498524.571561:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864651648 00000100:00100000:3.0:1789498524.571662:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 199 00000100:00100000:3.0:1789498524.571675:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+39:11572:x1876424864651648:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498524.571723:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498524.571758:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18f64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a309 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.572436:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.572486:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.572501:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498524.572560:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789498524.572564:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498524.572589:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.572626:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18f64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a309 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.572666:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a309 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.572676:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:3.0:1789498524.572679:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498524.572683:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91200, rc 0) 00000100:00100000:3.0:1789498524.572829:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:11572:x1876424864651648:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1156us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498524.572839:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 199 00000100:00100000:2.0:1789498524.585724:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.585977:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864651904 00000100:00100000:3.0:1789498524.585991:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864651904 00000100:00100000:3.0:1789498524.586062:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 200 00000100:00100000:3.0:1789498524.586074:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+40:11572:x1876424864651904:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498524.586145:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498524.586187:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18f72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a310 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.586458:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.586474:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.586488:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498524.586499:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789498524.586662:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a310 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.586684:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a310 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.587421:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98eaa1d46f00) 00010000:00010000:3.0:1789498524.587425:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498524.587429:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90200, rc 0) 00000100:00100000:3.0:1789498524.587694:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+42:11572:x1876424864651904:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1612us (1975us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789498524.587703:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 200 00010000:00010000:2.0:1789498524.588902:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498524.594459:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498524.594507:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.594593:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864652288 00000100:00100000:3.0:1789498524.594608:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864652288 00000100:00100000:3.0:1789498524.594702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1789498524.594714:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+42:2358:x1876424864652288:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498524.594761:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498524.595530:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a310 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.595563:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98eaa1d46f00) 00010000:00010000:3.0:1789498524.595569:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498524.595757:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864652160 00000100:00100000:1.0:1789498524.595765:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864652160 00000100:00100000:1.0:1789498524.595840:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 201 00000100:00100000:1.0:1789498524.595850:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+42:11572:x1876424864652160:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498524.595890:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498524.595911:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a317 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.596035:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18f8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.596052:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.596066:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498524.596081:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789498524.596309:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a317 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.596326:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18f8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a317 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.596335:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98eaa1d46f00) 00010000:00010000:1.0:1789498524.596338:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789498524.596342:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf000, rc 0) 00000100:00100000:3.0:1789498524.596557:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+44:2358:x1876424864652288:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 1844us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498524.596568:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1789498524.596834:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:11572:x1876424864652160:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 985us (2389us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789498524.596842:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 201 00000100:00100000:1.0:1789498524.607251:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498524.607673:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864652416 00000100:00100000:2.0:1789498524.607687:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864652416 00000100:00100000:2.0:1789498524.607757:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:2.0:1789498524.607769:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+6:2355:x1876424864652416:12345-192.168.201.20@tcp:1:lfs.0 00010000:00010000:2.0:1789498524.607840:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.607876:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.607888:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498524.607893:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498524.607898:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.607943:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.607961:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 6 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498524.607979:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6704:1876424885616128:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498524.608133:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498524.612850:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6704:1876424885616128:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498524.612908:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498524.615737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.616259:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864652544 00000100:00100000:3.0:1789498524.616273:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864652544 00002000:00100000:3.0:1789498524.616338:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98eab9fff480 x1876424864652544/t0(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:555/0 lens 504/0 e 0 to 0 dl 1789498535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789498524.616352:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eab9fff480 with x1876424864652544 ext(0->8) 00010000:00010000:3.0:1789498524.616362:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 7 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.616382:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 7 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498524.616391:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98eab9fff480 00000100:00100000:3.0:1789498524.616431:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1789498524.616441:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864652544:12345-192.168.201.20@tcp:4:lfs.0 00000100:00100000:3.0:1789498524.622058:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2355:x1876424864652544:12345-192.168.201.20@tcp:4:lfs.0 Request processed in 5596us (6314us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789498524.622292:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00002000:00100000:3.0:1789498524.622315:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98eab9fff480 x1876424864652544/t4294967308(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:555/0 lens 504/448 e 0 to 0 dl 1789498535 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789498524.622327:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eab9fff480 with x1876424864652544 ext(0->8) 00010000:00010000:3.0:1789498524.622340:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 9 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.622364:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 9 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498524.622373:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98eab9fff480 00000100:00100000:2.0:1789498524.633347:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498524.633607:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864652672 00000100:00100000:0.0:1789498524.633622:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864652672 00010000:00010000:0.0:1789498524.633707:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 9 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498524.633764:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:0.0:1789498524.633785:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2357:x1876424864652672:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498524.633810:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789498524.633840:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789498524.633844:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789498523 00002000:00010000:0.0:1789498524.633847:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789498524 00002000:00010000:0.0:1789498524.633849:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789498523 00010000:00010000:0.0:1789498524.633857:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 9 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.633886:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 9 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.633917:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc18f5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a302 expref: 9 pid: 6702 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.633959:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498524.633965:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498524.633972:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.633983:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498524.634028:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498524.634174:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2357:x1876424864652672:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 399us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498524.634183:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00010000:00010000:2.0:1789498524.634464:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.634477:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.634509:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.634519:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.634529:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.634536:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498524.634541:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.634550:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.634564:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.634572:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077efbf1d/0x3a6cb1946bc18f9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498524.634651:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864652416:12345-192.168.201.20@tcp:1:lfs.0 Request processed in 26883us (27415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498524.634662:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:1.0:1789498524.653176:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498524.653219:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885616256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498524.653331:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498524.653821:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885616256 00000100:00100000:2.0:1789498524.653834:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885616256 00000100:00100000:2.0:1789498524.653961:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789498524.653973:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876424885616256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498524.654009:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498524.654081:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876424885616256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498524.654126:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789498524.654231:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885616256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498524.655926:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498524.655954:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885616384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498524.656034:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498524.660857:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.661373:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864652928 00000100:00100000:1.0:1789498524.661391:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864652928 00000100:00100000:1.0:1789498524.661475:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:1.0:1789498524.661697:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5953850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+43:11572:x1876424864652928:12345-192.168.201.20@tcp:35:lfs.0 00000004:00010000:1.0:1789498524.662776:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18f8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a317 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789498524.664588:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1789498524.664667:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789498524.666627:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000100:00100000:3.0:1789498524.666972:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885616384 00000100:00100000:3.0:1789498524.666987:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885616384 00010000:00010000:1.0:1789498524.667551:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.667578:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 47 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.667590:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.667671:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 47 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.667703:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 47 pid: 7250 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498524.667723:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1876424885616512:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498524.667850:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcf840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498524.668010:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789498524.668023:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885616384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498524.668076:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498524.668186:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885616384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (12152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.668194:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789498524.671195:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885616384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498524.671604:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1876424885616512:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498524.671646:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498524.673971:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.674723:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864653056 00000100:00100000:3.0:1789498524.674738:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864653056 00010000:00010000:3.0:1789498524.674795:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 48 pid: 7250 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498524.674847:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:3.0:1789498524.674859:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+48:2356:x1876424864653056:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498524.674890:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498524.674899:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 48 pid: 7250 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.674914:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 48 pid: 7250 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.674963:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099200/0x3a6cb1946bc18f48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2f4 expref: 48 pid: 7250 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.674985:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98eaa1d46f00) 00010000:00010000:3.0:1789498524.674992:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.675003:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.675013:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.675053:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498524.675195:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+47:2356:x1876424864653056:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 337us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498524.675214:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00010000:00010000:2.0:1789498524.675410:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.675420:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498524.675604:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789498524.675934:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1789498524.676077:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876424885616640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789498524.676203:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498524.676250:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498524.677346:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885616640 00000100:00100000:3.0:1789498524.677361:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885616640 00000100:00100000:3.0:1789498524.677445:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498524.677457:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1876424885616640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789498524.677581:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1876424885616640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 126us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498524.677590:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498524.677991:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876424885616640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789498524.678617:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789498524.678753:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876424885616768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789498524.678818:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498524.678854:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0dfe480 going to sleep for 11 seconds 00000100:00100000:3.0:1789498524.679512:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885616768 00000100:00100000:3.0:1789498524.679524:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885616768 00000100:00100000:3.0:1789498524.679583:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498524.679594:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1876424885616768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789498524.680636:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5849:x1876424885616768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1029us (1804us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789498524.680649:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498524.689333:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876424885616768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789498524.689496:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1789498524.689596:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.689611:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.689620:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.689640:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498524.689647:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.689657:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.689674:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98eaa1d46f00) 00010000:00010000:2.0:1789498524.689677:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789498524.689683:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498524.689959:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf200/0x3a6cb1946bc18fa3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789498524.690356:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789498524.690505:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789498524.690520:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424454429298ns, next at 425454426950ns, rc = 0 00000001:00080000:2.0:1789498524.690530:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789498524.690579:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98eaa1d46f00) 00010000:00010000:2.0:1789498524.690582:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789498524.690592:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf000/0x3a6cb1946bc18f8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a317 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498524.692277:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5953850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:11572:x1876424864652928:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 30779us (31501us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789498524.692294:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 56 00000020:00080000:2.0:1789498524.692302:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789498524.706955:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.707333:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864653184 00000100:00100000:3.0:1789498524.707347:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864653184 00000100:00100000:3.0:1789498524.707431:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00100000:3.0:1789498524.707443:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+50:11572:x1876424864653184:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498524.707477:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498524.707509:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18faa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a31e expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.707595:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a31e expref: 51 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.707615:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a31e expref: 51 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.707654:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:3.0:1789498524.707658:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498524.707663:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90200, rc 0) 00000100:00100000:3.0:1789498524.707747:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+51:11572:x1876424864653184:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 306us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498524.707755:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00100000:1.0:1789498524.724560:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498524.724700:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864653440 00000100:00100000:2.0:1789498524.724716:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864653440 00000100:00100000:2.0:1789498524.724814:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:2.0:1789498524.724829:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+51:11572:x1876424864653440:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498524.725240:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:11572:x1876424864653440:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 413us (693us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789498524.725248:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:2.0:1789498524.865313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.865452:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864653568 00000100:00100000:1.0:1789498524.865466:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864653568 00000100:00100000:1.0:1789498524.865552:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 203 00000100:00100000:1.0:1789498524.865565:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:11582:x1876424864653568:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:1.0:1789498524.865700:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.865725:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.865767:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.865787:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.865795:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.865814:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.865938:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.865947:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.865954:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498524.866017:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866034:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866041:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866049:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866069:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498524.866074:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866155:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866172:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:1.0:1789498524.866176:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498524.866182:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866188:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc18fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866206:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866212:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866218:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866223:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498524.866226:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866231:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866250:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea930e1900) 00010000:00010000:1.0:1789498524.866253:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498524.866256:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866263:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18fb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866280:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866287:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866292:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866297:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498524.866299:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866306:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866313:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:1.0:1789498524.866315:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498524.866318:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.866324:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498524.866438:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:11582:x1876424864653568:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 875us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.866447:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 203 00000100:00100000:1.0:1789498524.941143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.941401:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864653824 00000100:00100000:3.0:1789498524.941416:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864653824 00000100:00100000:3.0:1789498524.941497:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:3.0:1789498524.941509:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+52:11585:x1876424864653824:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498524.941559:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498524.941591:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18fc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a325 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.941703:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.941723:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.941737:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.941759:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.941767:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.941774:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942408:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc18fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942421:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc18fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942430:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc18fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498524.942441:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789498524.942598:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942608:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942615:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942622:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498524.942637:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942646:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942659:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:3.0:1789498524.942662:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498524.942668:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942674:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc18fcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942692:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942698:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942704:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942708:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498524.942719:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942726:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942733:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea9108c200) 00010000:00010000:3.0:1789498524.942735:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498524.942739:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942745:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc18fd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942956:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc18fc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a325 expref: 55 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942976:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc18fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a325 expref: 54 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498524.942983:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:3.0:1789498524.942986:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498524.942989:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91600, rc 0) 00000100:00100000:3.0:1789498524.943518:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:11585:x1876424864653824:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1582us (2001us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789498524.943529:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:2.0:1789498524.957414:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498524.957657:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864653952 00000100:00100000:1.0:1789498524.957670:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864653952 00000100:00100000:1.0:1789498524.958646:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 205 00000100:00100000:1.0:1789498524.958666:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:11585:x1876424864653952:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:1.0:1789498524.958763:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958786:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958820:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958859:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958867:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958876:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958883:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498524.958889:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958924:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958938:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:1.0:1789498524.958942:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498524.958948:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498524.958954:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498524.959068:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:11585:x1876424864653952:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 409us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498524.959078:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 205 00000100:00100000:2.0:1789498524.968756:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498524.969073:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864654208 00000100:00100000:3.0:1789498524.969122:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864654208 00000100:00100000:3.0:1789498524.969210:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:3.0:1789498524.969223:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+54:11585:x1876424864654208:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498524.969663:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:11585:x1876424864654208:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 440us (923us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789498524.969672:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:2.0:1789498525.170070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498525.170280:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864654464 00000100:00100000:1.0:1789498525.170294:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864654464 00000100:00100000:1.0:1789498525.170382:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 206 00000100:00100000:1.0:1789498525.170396:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+55:11595:x1876424864654464:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498525.170430:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498525.170434:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789498525.170470:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc18f6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a309 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.170496:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:1.0:1789498525.170502:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498525.170521:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18ff0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a32c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.170706:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.170723:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.170736:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498525.170748:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789498525.171219:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc18ff0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a32c expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.171239:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a32c expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.171248:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:1.0:1789498525.171252:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498525.171255:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde600, rc 0) 00000100:00100000:1.0:1789498525.171435:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:11595:x1876424864654464:12345-192.168.201.20@tcp:101:bash.0 Request processed in 1042us (1381us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789498525.171444:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 206 00000100:00080000:0.0:1789498525.171819:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498525.177475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498525.177642:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864654720 00000100:00100000:0.0:1789498525.177657:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864654720 00000100:00100000:0.0:1789498525.177735:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 207 00000100:00100000:0.0:1789498525.177748:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:11595:x1876424864654720:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:0.0:1789498525.178036:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789498525.178076:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc18ff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a32c expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.178158:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc18fdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a325 expref: 55 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.178173:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:0.0:1789498525.178178:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498525.178713:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.178733:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.178746:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498525.179669:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1789498525.179722:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000524c4926 reply state 000000004cd159d7 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498525.179736:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498525.180642:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:11595:x1876424864654720:12345-192.168.201.20@tcp:36:bash.0 Request processed in 2889us (3175us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789498525.180653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 207 00000020:00080000:0.0:1789498525.180661:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498525.193140:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.193187:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.193260:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.193268:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498525.193274:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.193283:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.193303:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498525.193306:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498525.193311:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.193318:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19005 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498525.195609:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498525.196044:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864654848 00000100:00100000:1.0:1789498525.196058:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864654848 00000100:00100000:1.0:1789498525.196405:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 208 00000100:00100000:1.0:1789498525.196418:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+56:11595:x1876424864654848:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498525.196453:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498525.196502:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc1900c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a333 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.196648:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.196667:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.196683:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498525.196725:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789498525.196731:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498525.196759:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.196794:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc1900c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.196829:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.196840:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:1.0:1789498525.196843:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498525.196848:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddee00, rc 0) 00000100:00100000:1.0:1789498525.196938:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:11595:x1876424864654848:12345-192.168.201.20@tcp:101:bash.0 Request processed in 522us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498525.196946:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 208 00000100:00100000:1.0:1789498525.202905:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498525.203079:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864655104 00000100:00100000:3.0:1789498525.203144:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864655104 00000100:00100000:3.0:1789498525.203232:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:3.0:1789498525.203245:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+57:11595:x1876424864655104:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:3.0:1789498525.203595:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+58:11595:x1876424864655104:12345-192.168.201.20@tcp:35:bash.0 Request processed in 353us (709us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789498525.203604:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:2.0:1789498525.344353:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498525.344503:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864655232 00000100:00100000:1.0:1789498525.344520:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864655232 00000100:00100000:1.0:1789498525.344638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 209 00000100:00100000:1.0:1789498525.344654:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+58:11601:x1876424864655232:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498525.344699:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498525.344736:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc1901a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a33a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.344840:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc19021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.344861:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc19021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.344880:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc19021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498525.344942:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789498525.344947:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498525.344975:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc19021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.345012:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc1901a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a33a expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.345041:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc19021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a33a expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.345051:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:1.0:1789498525.345054:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498525.345078:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddfc00, rc 0) 00000100:00100000:1.0:1789498525.345228:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:11601:x1876424864655232:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 578us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498525.345237:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 209 00000100:00100000:0.0:1789498525.350417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498525.350702:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864655360 00000100:00100000:1.0:1789498525.350717:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864655360 00000100:00100000:1.0:1789498525.350808:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 210 00000100:00100000:1.0:1789498525.350821:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:11601:x1876424864655360:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498525.350852:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498525.350880:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc19028 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a341 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.350981:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351002:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351017:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351035:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351042:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351048:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351479:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc1903d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351510:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc1903d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351518:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc1903d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498525.351581:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789498525.351586:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498525.351613:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc1903d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351639:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc1903d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351648:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351656:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351664:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351671:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498525.351676:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351684:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351698:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:1.0:1789498525.351702:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498525.351715:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351723:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde600/0x3a6cb1946bc1902f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351741:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351747:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351752:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351758:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498525.351761:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351766:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351774:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98ea930e1900) 00010000:00010000:1.0:1789498525.351776:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498525.351779:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.351785:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc19036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.352081:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc19028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a341 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.352571:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc1903d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a341 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.352580:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:1.0:1789498525.352583:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498525.352586:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde400, rc 0) 00000100:00100000:1.0:1789498525.352714:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11601:x1876424864655360:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1895us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498525.352723:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 210 00000100:00100000:2.0:1789498525.362561:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498525.362686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498525.362768:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864655488 00000100:00100000:0.0:1789498525.362783:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864655488 00000100:00100000:0.0:1789498525.362874:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1789498525.362886:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:2357:x1876424864655488:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498525.362928:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498525.362966:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde400/0x3a6cb1946bc1903d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a341 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.362989:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:0.0:1789498525.362994:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498525.363069:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:2357:x1876424864655488:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 185us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498525.363077:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:1.0:1789498525.371075:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864655744 00000100:00100000:1.0:1789498525.371451:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864655744 00000100:00100000:1.0:1789498525.371580:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 211 00000100:00100000:1.0:1789498525.371593:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:11601:x1876424864655744:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498525.371634:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498525.371665:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc19044 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a348 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.371821:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.371838:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.371847:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.371893:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.371928:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 60 pid: 5847 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498525.371944:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885616896:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498525.372086:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcf780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498525.386363:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885616896:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498525.386405:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498525.388796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498525.388956:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864655872 00000100:00100000:1.0:1789498525.388970:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864655872 00010000:00010000:1.0:1789498525.389030:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 61 pid: 5847 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498525.389087:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1789498525.389142:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:2355:x1876424864655872:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498525.389164:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498525.389173:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 61 pid: 5847 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.389204:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 61 pid: 5847 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.389233:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a333 expref: 61 pid: 5847 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.389287:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:1.0:1789498525.389293:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.389305:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.389314:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498525.389347:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498525.389424:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:2355:x1876424864655872:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 284us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498525.389433:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00010000:00010000:2.0:1789498525.389979:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.389990:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498525.390032:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789498525.391700:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddf600/0x3a6cb1946bc19044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.391738:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498525.391749:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498525.391752:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498525.391756:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddea00, rc 0) 00000100:00100000:2.0:1789498525.394071:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11601:x1876424864655744:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 22462us (31366us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789498525.394112:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 211 00000100:00100000:1.0:1789498525.412125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498525.412458:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864656128 00000100:00100000:3.0:1789498525.412472:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864656128 00000100:00100000:3.0:1789498525.412561:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:3.0:1789498525.412574:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11601:x1876424864656128:12345-192.168.201.20@tcp:103:lfs.0 00010000:00010000:3.0:1789498525.412594:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498525.412638:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc18faa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a31e expref: 60 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498525.412664:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:3.0:1789498525.412670:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498525.412749:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:11601:x1876424864656128:12345-192.168.201.20@tcp:103:lfs.0 Request processed in 178us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498525.412757:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498525.417077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498525.420834:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864656256 00000100:00100000:3.0:1789498525.420860:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864656256 00000100:00100000:3.0:1789498525.420948:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 212 00000100:00100000:3.0:1789498525.420960:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:11601:x1876424864656256:12345-192.168.201.20@tcp:58:lfs.0 00010000:00010000:3.0:1789498525.421131:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498525.421155:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498525.421172:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498525.421454:0:7250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789498525.421725:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:11601:x1876424864656256:12345-192.168.201.20@tcp:58:lfs.0 Request processed in 765us (4662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498525.421734:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 212 00000100:00100000:2.0:1789498525.451387:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498525.451521:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864656384 00000100:00100000:0.0:1789498525.451539:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864656384 00000100:00100000:0.0:1789498525.451630:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 213 00000100:00100000:0.0:1789498525.451642:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+59:11601:x1876424864656384:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498525.451669:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498525.451697:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a34f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.451790:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.451803:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a34f expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.451827:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.451841:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a34f expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.451879:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:0.0:1789498525.451883:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498525.451887:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a34f expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498525.451896:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4400, rc 0) 00000100:00100000:0.0:1789498525.451973:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11601:x1876424864656384:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 332us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498525.451980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 213 00010000:00010000:3.0:1789498525.611560:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498526.191068:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789498526.194445:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498526.194902:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789498526.194911:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789498526.197912:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874be680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885617024:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789498526.198070:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850efd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498526.205051:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874be680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885617024:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789498526.209167:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498526.209555:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864656512 00000100:00100000:2.0:1789498526.209566:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864656512 00000100:00100000:2.0:1789498526.209639:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:2.0:1789498526.209651:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11604:x1876424864656512:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789498526.209686:0:7250:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789498526.209805:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11604:x1876424864656512:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 156us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498526.209814:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:1.0:1789498526.219034:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.219136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864656640 00000100:00100000:3.0:1789498526.219145:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864656640 00000100:00100000:3.0:1789498526.219194:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00100000:3.0:1789498526.219203:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11604:x1876424864656640:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789498526.219279:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219309:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219323:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219386:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219394:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219401:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219422:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219430:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219437:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498526.219572:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789498526.219576:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498526.219588:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219598:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219623:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219630:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219636:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498526.219640:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219648:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219659:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:3.0:1789498526.219661:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498526.219665:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219671:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19067 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219685:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219691:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219697:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219702:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498526.219708:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219714:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219721:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff98ea9108cb00) 00010000:00010000:3.0:1789498526.219723:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498526.219725:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219730:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1906e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219743:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219748:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219762:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219767:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498526.219770:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219776:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219783:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:3.0:1789498526.219785:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498526.219794:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.219799:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90400/0x3a6cb1946bc19075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.219878:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11604:x1876424864656640:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 Request processed in 674us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498526.219886:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00100000:0.0:1789498526.224948:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498526.225152:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864656896 00000100:00100000:2.0:1789498526.225165:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864656896 00000100:00100000:2.0:1789498526.225227:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 216 00000100:00100000:2.0:1789498526.225237:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+60:11604:x1876424864656896:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498526.225272:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498526.225293:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098a00/0x3a6cb1946bc1907c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a356 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225404:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225422:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225434:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498526.225445:0:7250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789498526.225631:0:7250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225639:0:7250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225645:0:7250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225651:0:7250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498526.225655:0:7250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225662:0:7250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225674:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498526.225683:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789498526.225688:0:7250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225694:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc19083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225736:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098a00/0x3a6cb1946bc1907c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a356 expref: 62 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225747:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:2.0:1789498526.225749:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498526.225754:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098a00/0x3a6cb1946bc1907c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a356 expref: 62 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.225763:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098a00, rc 0) 00000100:00100000:2.0:1789498526.225822:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:11604:x1876424864656896:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 586us (882us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789498526.225830:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 216 00000100:00100000:3.0:1789498526.234757:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.234790:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864657024 00000100:00100000:3.0:1789498526.234801:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864657024 00000100:00100000:3.0:1789498526.234855:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 217 00000100:00100000:3.0:1789498526.234867:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:11604:x1876424864657024:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498526.234902:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498526.235005:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:11604:x1876424864657024:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498526.235013:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 217 00000100:00100000:1.0:1789498526.240566:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.240854:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864657280 00000100:00100000:0.0:1789498526.240866:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864657280 00000100:00100000:0.0:1789498526.240927:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 218 00000100:00100000:0.0:1789498526.240938:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:11604:x1876424864657280:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498526.240958:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498526.240962:0:7250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789498526.240991:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc19021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a33a expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.241017:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:0.0:1789498526.241022:0:7250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498526.241036:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19091 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a35d expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789498526.241490:0:7250:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789498526.241719:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc19098 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.241750:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc19098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.241774:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc19098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.241833:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19091 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a35d expref: 63 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.241850:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc19098 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a35d expref: 62 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.241858:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98ea84ebf000) 00010000:00010000:0.0:1789498526.241860:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789498526.241863:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5e00, rc 0) 00000100:00100000:0.0:1789498526.241925:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+62:11604:x1876424864657280:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 989us (1368us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789498526.241933:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 218 00000001:00080000:0.0:1789498526.249335:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789498526.249358:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1789498526.252968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.259496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864657536 00000100:00100000:0.0:1789498526.259512:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864657536 00000100:00100000:0.0:1789498526.259572:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00100000:0.0:1789498526.259584:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+62:11604:x1876424864657536:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789498526.259655:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498526.259684:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc19098 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a35d expref: 62 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259724:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98ea84ebf000) 00010000:00010000:0.0:1789498526.259736:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498526.259757:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259770:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259780:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259815:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259823:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259831:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259910:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259918:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259925:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259931:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498526.259935:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259949:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259958:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:0.0:1789498526.259961:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498526.259965:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259971:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259980:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259987:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259992:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.259996:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498526.259998:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.260003:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.260009:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbc1ccbb3 (ffff98ea84ebff00) 00010000:00010000:0.0:1789498526.260012:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498526.260014:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.260028:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbc1ccbb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498526.260592:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:11604:x1876424864657536:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 1007us (7636us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789498526.260610:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00100000:0.0:1789498526.265242:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498526.265409:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864657664 00000100:00100000:2.0:1789498526.265420:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864657664 00000100:00100000:2.0:1789498526.265489:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00100000:2.0:1789498526.265498:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+61:11604:x1876424864657664:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498526.265519:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498526.265543:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098a00/0x3a6cb1946bc190b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a364 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.265581:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.265641:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.265654:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.265757:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098a00/0x3a6cb1946bc190b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 63 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.265776:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 62 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.265785:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498526.265788:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789498526.265792:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098c00, rc 0) 00000100:00100000:2.0:1789498526.265854:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+62:11604:x1876424864657664:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 357us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498526.265863:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00100000:1.0:1789498526.277992:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.278127:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864657920 00000100:00100000:0.0:1789498526.278140:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864657920 00000100:00100000:0.0:1789498526.278203:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 221 00000100:00100000:0.0:1789498526.278214:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+62:11604:x1876424864657920:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789498526.278298:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.278318:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.278330:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498526.278644:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1789498526.278656:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426042564397ns, next at 427042561631ns, rc = 0 00000004:00010000:0.0:1789498526.278763:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050f45d9d reply state 00000000edaddc45 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498526.278773:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498526.278874:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+64:11604:x1876424864657920:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 662us (892us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789498526.278898:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 221 00000100:00100000:3.0:1789498526.295861:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:2.0:1789498526.295981:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.295995:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.296003:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.296009:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498526.296015:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.296038:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.296055:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498526.296058:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789498526.296064:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.296071:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc190c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498526.296305:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864658048 00000100:00100000:0.0:1789498526.296315:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864658048 00000100:00100000:0.0:1789498526.296371:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 222 00000100:00100000:0.0:1789498526.296381:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+63:11604:x1876424864658048:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498526.296407:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498526.296425:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a36b expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.296492:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 64 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.296507:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 64 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.296530:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:0.0:1789498526.296533:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498526.296536:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4c00, rc 0) 00000100:00100000:0.0:1789498526.296608:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+64:11604:x1876424864658048:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 220us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498526.296616:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 222 00000100:00100000:1.0:1789498526.300589:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498526.300697:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864658176 00000100:00100000:2.0:1789498526.300712:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864658176 00000100:00100000:2.0:1789498526.300799:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:2.0:1789498526.300815:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2356:x1876424864658176:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789498526.301345:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2356:x1876424864658176:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 533us (774us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789498526.301436:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00080000:0.0:1789498526.301989:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498526.307902:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.315805:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864658432 00000100:00100000:3.0:1789498526.315823:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864658432 00000100:00100000:3.0:1789498526.315986:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:3.0:1789498526.316000:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+64:11604:x1876424864658432:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789498526.316378:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+65:11604:x1876424864658432:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 380us (8486us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789498526.316386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:1.0:1789498526.321200:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.321270:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864658688 00000100:00100000:0.0:1789498526.321282:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864658688 00000100:00100000:0.0:1789498526.321345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 223 00000100:00100000:0.0:1789498526.321357:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+65:11604:x1876424864658688:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789498526.321500:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+65:11604:x1876424864658688:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 144us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498526.321507:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 223 00000100:00100000:1.0:1789498526.350808:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.350904:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864658816 00000100:00100000:0.0:1789498526.350916:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864658816 00000100:00100000:0.0:1789498526.350973:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00100000:0.0:1789498526.350983:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+65:11604:x1876424864658816:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498526.351005:0:7250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498526.351026:0:7250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc190d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a372 expref: -99 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.351140:0:7250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc190d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.351156:0:7250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc190d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.351168:0:7250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc190d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498526.351209:0:7250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498526.351226:0:7250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc190d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.351251:0:7250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc190d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a372 expref: 67 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.351270:0:7250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc190d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a372 expref: 66 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.351298:0:7250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:0.0:1789498526.351301:0:7250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789498526.351305:0:7250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5000, rc 0) 00000100:00100000:0.0:1789498526.351430:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+66:11604:x1876424864658816:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 448us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498526.351437:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00100000:2.0:1789498526.362866:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.362990:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864658944 00000100:00100000:3.0:1789498526.363001:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864658944 00000100:00100000:3.0:1789498526.363065:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:3.0:1789498526.363077:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+10:2355:x1876424864658944:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498526.363274:0:10445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498526.363298:0:10445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a379 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498526.363327:0:10445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9949d, blocks: 0x1 00010000:00010000:3.0:1789498526.363347:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1789498526.363351:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498526.363361:0:10445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 11 pid: 10445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.363379:0:10445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 11 pid: 10445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.363393:0:10445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90400, rc 0) 00000100:00100000:3.0:1789498526.363456:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:2355:x1876424864658944:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 382us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498526.363463:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:2.0:1789498526.376740:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.376843:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864659200 00000100:00100000:0.0:1789498526.376855:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864659200 00000100:00100000:0.0:1789498526.376916:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00100000:0.0:1789498526.376927:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+66:11604:x1876424864659200:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789498526.377046:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+66:11604:x1876424864659200:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498526.377054:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00100000:1.0:1789498526.389401:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.389805:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864659328 00000100:00100000:3.0:1789498526.389817:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864659328 00000100:00100000:3.0:1789498526.389880:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:3.0:1789498526.389891:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:11604:x1876424864659328:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498526.389911:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498526.389947:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a380 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.389986:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 12 pid: 10445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.389996:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498526.390001:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498526.390006:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.390044:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 12 pid: 10445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.390059:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 12 pid: 10445 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.390074:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1876424885617152:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498526.390463:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85065180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498526.401030:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1876424885617152:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498526.401073:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.401134:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91e00, rc 0) 00000100:00100000:0.0:1789498526.401675:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:11604:x1876424864659328:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 11782us (12282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498526.401686:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:1.0:1789498526.414969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.415079:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864659456 00000100:00100000:0.0:1789498526.415127:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864659456 00010000:00010000:0.0:1789498526.415189:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 12 pid: 10445 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498526.415232:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:0.0:1789498526.415242:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85663c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+12:2356:x1876424864659456:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498526.415263:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498526.415287:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 12 pid: 10445 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.415303:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 12 pid: 10445 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.415326:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005577f7b/0x3a6cb1946bc190de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a379 expref: 12 pid: 10445 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.415342:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498526.415347:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498526.415355:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.415366:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.415402:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498526.415429:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876424885617280:192.168.201.20@tcp:105: 00000100:00100000:0.0:1789498526.415521:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498526.418344:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876424885617280:192.168.201.20@tcp:105: 00010000:00010000:2.0:1789498526.418372:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498526.418430:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85663c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:2356:x1876424864659456:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 3189us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498526.418440:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:2.0:1789498526.435937:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.436466:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864659584 00000100:00100000:0.0:1789498526.436490:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864659584 00002000:00100000:0.0:1789498526.436545:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98eab9fbea00 x1876424864659584/t0(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:557/0 lens 504/0 e 0 to 0 dl 1789498537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789498526.436557:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eab9fbea00 with x1876424864659584 ext(0->12) 00002000:00010000:0.0:1789498526.436563:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eab9fbea00 00000100:00100000:0.0:1789498526.436608:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:0.0:1789498526.436619:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+11:2355:x1876424864659584:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789498526.437160:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:2355:x1876424864659584:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 Request processed in 542us (1233us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789498526.437169:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00002000:00100000:0.0:1789498526.437177:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98eab9fbea00 x1876424864659584/t4294967320(0) o4->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:557/0 lens 504/448 e 0 to 0 dl 1789498537 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789498526.437185:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eab9fbea00 with x1876424864659584 ext(0->12) 00002000:00010000:0.0:1789498526.437189:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eab9fbea00 00000100:00100000:1.0:1789498526.442146:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.442298:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864659712 00000100:00100000:0.0:1789498526.442309:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864659712 00000100:00100000:0.0:1789498526.442372:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 226 00000100:00100000:0.0:1789498526.442383:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+66:11604:x1876424864659712:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789498526.557606:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+66:11604:x1876424864659712:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 Request processed in 115207us (115452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498526.557634:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 226 00000001:00080000:1.0:1789498526.557674:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1789498526.557682:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1789498526.557720:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789498526.557735:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98ea87fcf3c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789498526.557739:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98eaba8b5f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98ea87fcf240 00000020:00080000:1.0:1789498526.557742:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98eaba8b5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98eab9fb7c00 00000004:00080000:1.0:1789498526.557762:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789498526.557776:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98ea85065b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789498526.557780:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e9853af500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98ea8676c000 00000020:00080000:1.0:1789498526.557782:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e9853af400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98eabadb8800 00000001:00080000:1.0:1789498526.557802:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1789498526.558179:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789498526.558663:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789498526.558760:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885617408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789498526.558833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498526.558904:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498526.558911:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885617536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789498526.558933:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498526.559639:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885617664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789498526.559687:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498526.559917:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885617408 00000100:00100000:1.0:1789498526.559925:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885617408 00000100:00080000:0.0:1789498526.560045:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498526.560162:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885617536 00000100:00100000:3.0:1789498526.560167:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885617536 00000100:00100000:3.0:1789498526.560195:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885617664 00000100:00100000:3.0:1789498526.560199:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885617664 00000100:00100000:3.0:1789498526.560232:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789498526.560241:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885617408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789498526.560270:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1789498526.560294:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.560329:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.560338:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789498526.560343:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498526.560347:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.560376:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.560391:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 12 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.560404:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1876424885617792:192.168.201.20@tcp:104: 00000100:00080000:2.0:1789498526.560661:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498526.560811:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498526.560820:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885617536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789498526.561033:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85065780 going to sleep for 11 seconds 00002000:00010000:1.0:1789498526.561282:0:10445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789498526.561286:0:10445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789498526 00002000:00010000:1.0:1789498526.561295:0:10445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789498526.561297:0:10445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789498525 -> 1789498526 00002000:00010000:1.0:1789498526.561299:0:10445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789498526.561470:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1876424885617536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 650us (2534us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789498526.561491:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498526.561512:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498526.561519:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885617664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789498526.561533:0:10445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789498526.561557:0:10445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa9949b, atime: 0x6aa9949c, ctime: 0x6aa9949b, blocks: 0xb 00010000:00010000:1.0:1789498526.561564:0:10445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.561576:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1789498526.561579:0:10445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498526.561585:0:10445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.561610:0:10445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.561621:0:10445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.561628:0:10445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.561662:0:10445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498526.562555:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498526.562564:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.562574:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498526.562578:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.562588:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.562624:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.562631:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061bca213/0x3a6cb1946bc190f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.562650:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498526.562652:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498526.562654:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498526.562886:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885617664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1365us (3196us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789498526.562894:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789498526.562987:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.563011:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864659840 00000100:00100000:3.0:1789498526.563018:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864659840 00000004:00080000:2.0:1789498526.563354:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eabaa8fb80/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789498526.563362:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885617536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789498526.563442:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789498526.563739:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eabb4a7100, transno 4294967307 00000004:00080000:0.0:1789498526.563794:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1789498526.563831:0:3307:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98eaba122680 x1876424885617664/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789498542 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789498526.563842:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eaba122680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789498526.563843:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:0.0:1789498526.564765:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885617664:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789498526.566816:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+13:2355:x1876424864659840:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789498526.566971:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.567541:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864659968 00000100:00100000:3.0:1789498526.567550:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864659968 00010000:00010000:3.0:1789498526.567585:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 14 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.567634:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:3.0:1789498526.567643:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2356:x1876424864659968:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498526.567656:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498526.567662:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 14 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.567692:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 14 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.567717:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498526.567721:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498526.567727:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.567736:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.567755:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498526.567802:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+14:2356:x1876424864659968:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 160us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498526.567810:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00010000:00010000:2.0:1789498526.567844:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6942ce2/0x3a6cb1946bc18eae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2df expref: 13 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.567860:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1876424885617792:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498526.567878:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.567887:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.567895:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.567905:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.567912:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.567933:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498526.568014:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498526.568020:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.568182:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498526.568187:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.568196:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.568218:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.568225:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc190ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.568243:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498526.568245:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498526.568247:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498526.568635:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1876424885617408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8392us (9799us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789498526.568643:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1789498526.569237:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eabaa8e680/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789498526.569247:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885617408:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1789498526.618435:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1789498526.618459:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1789498526.618467:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1789498526.619035:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864659840:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 Request processed in 55176us (56043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498526.619045:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:0.0:1789498526.627859:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498526.628067:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864660224 00000100:00100000:1.0:1789498526.628077:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864660224 00000100:00100000:3.0:1789498526.628228:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 227 00000100:00100000:3.0:1789498526.628241:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:11604:x1876424864660224:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789498526.628383:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498526.628420:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc190d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a372 expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.628439:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498526.628444:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498526.628480:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.628493:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.628504:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498526.628782:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f76f2b0 reply state 00000000edb04652 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.628792:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498526.628891:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:11604:x1876424864660224:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 653us (1043us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789498526.628899:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 227 00010000:00010000:2.0:1789498526.633550:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.633568:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.633576:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.633583:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498526.633617:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.633626:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.633647:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498526.633650:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498526.633656:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.633662:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099600/0x3a6cb1946bc190fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498526.633755:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.641325:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864660352 00000100:00100000:0.0:1789498526.641357:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864660352 00010000:00010000:3.0:1789498526.641375:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498526.641447:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:0.0:1789498526.641459:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864660352:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789498526.641720:0:10445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789498526.641725:0:10445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789498526 -> 1789498524 00002000:00010000:0.0:1789498526.641727:0:10445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789498524 00002000:00010000:0.0:1789498526.641729:0:10445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789498526 -> 1789498524 00002000:00010000:0.0:1789498526.641731:0:10445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789498526.641808:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864660352:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 351us (8057us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789498526.641817:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:2.0:1789498526.645254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.645324:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864660608 00000100:00100000:3.0:1789498526.645335:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864660608 00000100:00100000:3.0:1789498526.647657:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:3.0:1789498526.647683:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:11604:x1876424864660608:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789498526.647760:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.647778:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.647788:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.647842:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.647858:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 20 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.647872:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885617920:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498526.654385:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea81254000 going to sleep for 11 seconds 00000100:00100000:3.0:1789498526.672379:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876424885617920:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498526.672424:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498526.673448:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498526.673909:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864660736 00000100:00100000:2.0:1789498526.673918:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864660736 00010000:00010000:2.0:1789498526.673975:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 21 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.674019:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:2.0:1789498526.674041:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:2355:x1876424864660736:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498526.674056:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498526.674063:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 21 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.674075:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 21 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.674116:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc190bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a364 expref: 21 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.674147:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498526.674152:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.674163:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.674172:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.674207:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498526.674264:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:2355:x1876424864660736:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 236us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498526.674272:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00010000:00010000:1.0:1789498526.678906:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.678925:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.678985:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.678994:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.679002:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.679008:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498526.679013:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.679056:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.679072:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:1.0:1789498526.679075:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789498526.679081:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.679116:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91000/0x3a6cb1946bc19101 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498526.679228:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:11604:x1876424864660608:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 Request processed in 31552us (33977us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789498526.679241:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:1.0:1789498526.696551:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498526.696666:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864660864 00000100:00100000:2.0:1789498526.696678:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864660864 00000100:00100000:2.0:1789498526.696745:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:2.0:1789498526.696755:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864660864:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789498526.696808:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.696832:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.696840:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498526.696844:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498526.696850:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.696907:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.696921:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 8 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.696935:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1876424885618048:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498526.697028:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789498526.707295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498526.707730:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1876424885618048:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498526.707758:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.707880:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864660992 00000100:00100000:3.0:1789498526.707889:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864660992 00010000:00010000:3.0:1789498526.707930:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 9 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.707979:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:3.0:1789498526.707989:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+9:2356:x1876424864660992:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498526.708005:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498526.708029:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 9 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.708043:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 9 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.708118:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003543d320/0x3a6cb1946bc190e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a380 expref: 9 pid: 6702 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.708136:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498526.708140:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789498526.708146:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.708156:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.708188:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498526.708238:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.708248:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.708249:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2356:x1876424864660992:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 261us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498526.708266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00010000:00010000:2.0:1789498526.708276:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.708284:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.708304:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.708311:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498526.708315:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.708325:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.708350:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.708356:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc19108 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.708402:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864660864:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 Request processed in 11648us (11864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498526.708409:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:1.0:1789498526.712175:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.712288:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864661248 00000100:00100000:0.0:1789498526.712299:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864661248 00000100:00100000:0.0:1789498526.712363:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 229 00000100:00100000:0.0:1789498526.712374:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:11604:x1876424864661248:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789498526.712457:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.712485:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.712499:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.712779:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.712791:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.712799:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.712836:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.712852:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 20 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498526.712867:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba132300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885618176:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498526.712967:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea8562bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498526.720827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498526.720979:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba132300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885618176:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498526.721009:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.721355:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864661376 00000100:00100000:2.0:1789498526.721364:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864661376 00010000:00010000:2.0:1789498526.721405:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 21 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.721482:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:2.0:1789498526.721505:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:2356:x1876424864661376:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498526.721519:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498526.721526:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 21 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.721538:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 21 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.721560:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc190c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a36b expref: 21 pid: 7250 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.721574:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:2.0:1789498526.721579:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.721588:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.721608:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.721635:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498526.721695:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:2356:x1876424864661376:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 190us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498526.721702:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00010000:00010000:1.0:1789498526.721755:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.721763:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789498526.722000:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1789498526.722204:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789498526.722278:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1789498526.722372:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1876424885618304:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789498526.722438:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498526.722471:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84e76cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498526.722498:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885618304 00000100:00100000:1.0:1789498526.722503:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885618304 00000100:00100000:1.0:1789498526.722537:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789498526.722545:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1876424885618304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789498526.722629:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1876424885618304:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498526.722637:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789498526.722672:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1789498526.722677:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1789498526.722694:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eabaa8fb80, transno 4294967321 00000100:00100000:1.0:1789498526.722708:0:5845:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98eabaa8e680 x1876424885617408/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789498542 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498526.722718:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1876424885618304:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789498526.723286:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789498526.723343:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1876424885618432:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789498526.723381:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498526.723401:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcf840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498526.723585:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885618432 00000100:00100000:1.0:1789498526.723604:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885618432 00000100:00100000:1.0:1789498526.723641:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498526.723650:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1876424885618432:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789498526.723804:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1876424885618432:12345-0@lo:1000:mdt00_000.0 Request processed in 155us (421us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789498526.723822:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498526.723877:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1876424885618432:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789498526.723911:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.723920:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.723928:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.723933:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498526.723937:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.723945:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.723957:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98eaa1d46600) 00010000:00010000:1.0:1789498526.723961:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498526.723965:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.723972:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19116 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.723999:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.724004:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.724020:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.724024:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498526.724027:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.724033:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.724041:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:1.0:1789498526.724044:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498526.724050:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a34f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.724061:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a34f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.724070:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a34f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498526.724116:0:5845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a34f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498526.724129:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885618560:192.168.201.20@tcp:105: 00000100:00100000:1.0:1789498526.724186:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84f7fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498526.732279:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.732641:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864661504 00000100:00100000:0.0:1789498526.732651:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864661504 00000100:00100000:0.0:1789498526.733044:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:0.0:1789498526.733057:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11601:x1876424864661504:12345-192.168.201.20@tcp:49:lfs.0 00000100:00100000:0.0:1789498526.733425:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11601:x1876424864661504:12345-192.168.201.20@tcp:49:lfs.0 Request processed in 369us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498526.733433:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:2.0:1789498526.733529:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876424885618560:192.168.201.20@tcp:105: 00010000:00010000:2.0:1789498526.733560:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733589:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc19059 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733634:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733651:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733663:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733674:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733681:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733687:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733692:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498526.733696:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733702:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733713:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498526.733717:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498526.733720:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733731:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1911d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733741:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733747:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733752:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733757:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498526.733760:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733765:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733773:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498526.733776:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789498526.733778:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.733783:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1910f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.734114:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:11604:x1876424864661248:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 21741us (21948us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789498526.734122:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 229 00000020:00080000:2.0:1789498526.734133:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789498526.734294:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789498526.734300:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498526.734886:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789498526.734896:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789498526.739513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498526.739609:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498526.739627:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864661760 00000100:00100000:1.0:1789498526.739648:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864661760 00000100:00100000:1.0:1789498526.739719:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00100000:1.0:1789498526.739730:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+23:11601:x1876424864661760:12345-192.168.201.20@tcp:58:lfs.0 00000100:00100000:3.0:1789498526.739840:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864662016 00000100:00100000:3.0:1789498526.739846:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864662016 00000100:00100000:3.0:1789498526.739886:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:3.0:1789498526.739895:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5953450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11604:x1876424864662016:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1789498526.740361:0:7250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789498526.740466:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+24:11601:x1876424864661760:12345-192.168.201.20@tcp:58:lfs.0 Request processed in 737us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498526.740475:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 230 00000004:00080000:3.0:1789498526.741772:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789498526.741905:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1789498526.741966:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.741983:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.741995:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.742004:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.742010:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.742017:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.742033:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498526.743119:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498526.743131:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.743143:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498526.743148:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.743158:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.743173:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:0.0:1789498526.743177:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789498526.743182:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.743188:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc19124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498526.743211:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498526.743232:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498526.743234:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498526.745025:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5953450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+25:11604:x1876424864662016:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 5120us (5404us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789498526.745039:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000020:00080000:3.0:1789498526.745049:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789498526.795973:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498526.796221:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864662144 00000100:00100000:2.0:1789498526.796234:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864662144 00000100:00100000:2.0:1789498526.796299:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 231 00000100:00100000:2.0:1789498526.796310:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+25:11606:x1876424864662144:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498526.796338:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498526.796363:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1912b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a387 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796448:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796463:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796475:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796490:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796496:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796503:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796782:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796795:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796817:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796854:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.796869:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 26 pid: 5845 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498526.796884:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885618688:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498526.797052:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e9852e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498526.807246:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498526.807745:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864662400 00000100:00100000:1.0:1789498526.807759:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864662400 00000100:00100000:1.0:1789498526.807821:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:1.0:1789498526.807832:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:5598:x1876424864662400:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789498526.808148:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:5598:x1876424864662400:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 316us (920us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789498526.808156:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:2.0:1789498526.809232:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876424885618688:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498526.809262:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498526.815441:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498526.815880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864662528 00000100:00100000:3.0:1789498526.815892:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864662528 00010000:00010000:3.0:1789498526.815945:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 28 pid: 5845 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.816002:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:3.0:1789498526.816013:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:2355:x1876424864662528:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498526.816030:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498526.816052:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 28 pid: 5845 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.816067:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 28 pid: 5845 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.816141:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddea00/0x3a6cb1946bc1904b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a348 expref: 28 pid: 5845 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.820333:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:3.0:1789498526.820348:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.820362:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.820371:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498526.820413:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498526.820453:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820465:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498526.820499:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:2355:x1876424864662528:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 4484us (5063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498526.820510:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000004:00200000:2.0:1789498526.820528:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789498526.820535:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498526.820559:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820573:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820618:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820626:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820633:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820640:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498526.820645:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820652:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820665:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498526.820668:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498526.820673:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820679:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099800/0x3a6cb1946bc19132 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820696:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820703:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820709:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820722:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498526.820725:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820731:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820740:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98eaa1d46f00) 00010000:00010000:2.0:1789498526.820742:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498526.820746:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820752:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099c00/0x3a6cb1946bc19139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820796:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098c00/0x3a6cb1946bc1912b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a387 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820812:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a387 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498526.820819:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498526.820822:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498526.820824:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099000, rc 0) 00000100:00100000:2.0:1789498526.820925:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11606:x1876424864662144:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 24615us (24964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498526.820935:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 231 00010000:00010000:3.0:1789498527.659216:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498527.788032:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789498527.788042:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498527.788112:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789498527.788118:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789498527.788257:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885618816:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789498527.790730:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498527.824891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498527.824993:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876424885618816:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789498527.825796:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864662656 00000100:00100000:2.0:1789498527.825811:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864662656 00000100:00100000:2.0:1789498527.826112:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 232 00000100:00100000:2.0:1789498527.826124:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11617:x1876424864662656:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789498527.826184:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789498527.826336:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11617:x1876424864662656:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 213us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498527.826343:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 232 00000100:00100000:3.0:1789498527.839451:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498527.839696:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864662912 00000100:00100000:0.0:1789498527.839709:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864662912 00000100:00100000:0.0:1789498527.839775:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 233 00000100:00100000:0.0:1789498527.839786:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+26:11617:x1876424864662912:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498527.839808:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498527.839830:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19147 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a38e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498527.839951:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1914e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498527.839967:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1914e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498527.839979:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1914e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498527.839990:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789498527.840152:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19147 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a38e expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498527.840188:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1914e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a38e expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498527.840197:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:0.0:1789498527.840200:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789498527.840213:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4200, rc 0) 00000100:00100000:0.0:1789498527.840281:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11617:x1876424864662912:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 497us (840us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789498527.840297:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 233 00000100:00080000:1.0:1789498527.840616:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498527.848224:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498527.848626:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864663040 00000100:00100000:0.0:1789498527.848637:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864663040 00000100:00100000:0.0:1789498527.848704:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:0.0:1789498527.848715:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:2356:x1876424864663040:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498527.848731:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498527.848758:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc1914e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a38e expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498527.848777:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:0.0:1789498527.848783:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498527.848842:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:2356:x1876424864663040:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 129us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498527.848850:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:0.0:1789498527.863787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498527.863874:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864663296 00000100:00100000:1.0:1789498527.863885:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864663296 00000100:00100000:1.0:1789498527.863952:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:1.0:1789498527.863963:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+27:11617:x1876424864663296:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789498527.864052:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864084:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864122:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864521:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864531:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864540:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864547:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498527.864554:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864563:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864591:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:1.0:1789498527.864596:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789498527.864602:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498527.864610:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc1915c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498527.864806:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11617:x1876424864663296:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 843us (1031us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789498527.864816:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 234 00000040:00080000:0.0:1789498527.865607:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498527.865614:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498527.866126:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789498527.866137:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789498527.875677:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498527.875814:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864663552 00000100:00100000:3.0:1789498527.875827:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864663552 00000100:00100000:3.0:1789498527.875908:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:3.0:1789498527.875920:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+28:11617:x1876424864663552:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789498527.878407:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11617:x1876424864663552:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 2476us (2729us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789498527.878424:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000040:00080000:3.0:1789498527.904440:0:12521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789498527.904452:0:12521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498527.904506:0:12521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789498527.904512:0:12521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789498528.150716:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498528.150762:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498528.150790:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498528.150833:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498528.150860:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864663680 00000100:00100000:1.0:1789498528.150870:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864663680 00000100:00100000:1.0:1789498528.150919:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 302 00000100:00100000:1.0:1789498528.150927:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864663680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498528.150999:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864663680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498528.151007:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 302 00000100:00100000:1.0:1789498528.151041:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864664064 00000100:00100000:1.0:1789498528.151045:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864664064 00000100:00100000:1.0:1789498528.151087:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 173 00000100:00100000:1.0:1789498528.151121:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864664064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498528.151150:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864664064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498528.151157:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 173 00000100:00100000:1.0:1789498528.151175:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864663808 00000100:00100000:1.0:1789498528.151180:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864663808 00000100:00100000:1.0:1789498528.151207:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864663936 00000100:00100000:1.0:1789498528.151210:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864663936 00000100:00100000:1.0:1789498528.151232:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:1.0:1789498528.151239:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864663808:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498528.151805:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:0.0:1789498528.151817:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2357:x1876424864663936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498528.152477:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864663808:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1235us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498528.152488:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:0.0:1789498528.153446:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2357:x1876424864663936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1626us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498528.153468:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00080000:1.0:1789498528.162017:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498528.162030:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498528.162036:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498528.182895:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498528.182972:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864664320 00000100:00100000:3.0:1789498528.182984:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864664320 00000100:00100000:3.0:1789498528.183049:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 235 00000100:00100000:3.0:1789498528.183060:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabae8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+29:11630:x1876424864664320:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498528.183114:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498528.183140:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19163 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a395 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498528.183272:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc1916a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498528.183288:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc1916a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498528.183300:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc1916a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498528.183328:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789498528.183474:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc19163 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a395 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498528.183493:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc1916a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a395 expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498528.183502:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:3.0:1789498528.183505:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789498528.183511:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91c00, rc 0) 00000100:00100000:3.0:1789498528.183586:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabae8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:11630:x1876424864664320:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 528us (702us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789498528.183594:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 235 00000100:00100000:1.0:1789498528.186809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498528.186892:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864664448 00000100:00100000:2.0:1789498528.186904:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864664448 00000100:00100000:2.0:1789498528.187007:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 236 00000100:00100000:2.0:1789498528.187018:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:11630:x1876424864664448:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:2.0:1789498528.187132:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187153:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187164:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187198:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187206:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187213:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187234:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498528.187238:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187245:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187257:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498528.187260:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498528.187265:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.187272:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91098200/0x3a6cb1946bc19178 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498528.187352:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+31:11630:x1876424864664448:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 336us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498528.187360:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 236 00000100:00100000:3.0:1789498528.287210:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498528.287645:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864664576 00000100:00100000:2.0:1789498528.287659:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864664576 00000100:00100000:2.0:1789498528.287731:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:2.0:1789498528.287743:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2355:x1876424864664576:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:2.0:1789498528.287763:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498528.287787:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f761791/0x3a6cb1946bc1917f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a39c expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789498528.287818:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa9949c, atime: 0x6aa9949c, ctime: 0x6aa9949c, blocks: 0xb 00010000:00010000:2.0:1789498528.287843:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1789498528.287862:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498528.287871:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f761791/0x3a6cb1946bc1917f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a39c expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.287892:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f761791/0x3a6cb1946bc1917f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a39c expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498528.287905:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098200, rc 0) 00000100:00100000:2.0:1789498528.287977:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2355:x1876424864664576:12345-192.168.201.20@tcp:101:cat.0 Request processed in 236us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498528.287984:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:3.0:1789498528.292449:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498528.292637:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864664704 00000100:00100000:2.0:1789498528.292648:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864664704 00002000:00100000:2.0:1789498528.292709:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98eabad0ed80 x1876424864664704/t0(0) o3->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:559/0 lens 488/0 e 0 to 0 dl 1789498539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789498528.292723:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabad0ed80 with x1876424864664704 ext(0->4095) 00002000:00010000:2.0:1789498528.292729:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eabad0ed80 00000100:00100000:2.0:1789498528.292767:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:2.0:1789498528.292778:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2357:x1876424864664704:12345-192.168.201.20@tcp:3:cat.0 00000100:00100000:2.0:1789498528.293018:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+8:2357:x1876424864664704:12345-192.168.201.20@tcp:3:cat.0 Request processed in 240us (580us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789498528.293026:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00002000:00100000:2.0:1789498528.293034:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98eabad0ed80 x1876424864664704/t0(0) o3->0953f915-6ba0-4bbb-8a03-cecc9ebbc14c@192.168.201.20@tcp:559/0 lens 488/4536 e 0 to 0 dl 1789498539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789498528.293042:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eabad0ed80 with x1876424864664704 ext(0->4095) 00002000:00010000:2.0:1789498528.293073:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98eabad0ed80 00010000:00010000:0.0:1789498528.684448:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498528.876374:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789498528.876384:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498528.876416:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789498528.876438:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789498529.264994:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885619328:0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.265064:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498529.265136:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498529.265143:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885618944:0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.265172:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498529.265196:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885619456:0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.265222:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498529.265250:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885619072:0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.265272:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498529.265288:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885619584:0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.265318:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498529.265337:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498529.265342:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885619200:0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.265363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498529.265388:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885619456 00000100:00100000:3.0:1789498529.265395:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885619328 00000100:00100000:1.0:1789498529.265396:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885619456 00000100:00100000:3.0:1789498529.265398:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885619328 00000100:00100000:1.0:1789498529.265452:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885619072 00000100:00100000:1.0:1789498529.265456:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885619072 00000100:00100000:1.0:1789498529.265468:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885619200 00000100:00100000:1.0:1789498529.265471:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885619200 00000100:00100000:2.0:1789498529.265622:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789498529.265634:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885619456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498529.265707:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885619456:12345-0@lo:400:kworker.0 Request processed in 76us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498529.265714:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789498529.265733:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789498529.265738:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885619072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498529.265770:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885619072:12345-0@lo:400:kworker.0 Request processed in 31us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498529.265775:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789498529.265812:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885619072:0@lo:400:kworker.0 00000100:00100000:2.0:1789498529.265839:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885619456:0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.265978:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885619584 00000100:00100000:3.0:1789498529.265983:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885619584 00000100:00100000:3.0:1789498529.266009:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789498529.266016:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885619328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.266051:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885619328:12345-0@lo:400:kworker.0 Request processed in 35us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498529.266057:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789498529.266070:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789498529.266077:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885619584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.266135:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885619584:12345-0@lo:400:kworker.0 Request processed in 58us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498529.266141:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789498529.266161:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885618944 00000100:00100000:3.0:1789498529.266165:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885618944 00000100:00100000:3.0:1789498529.266190:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789498529.266197:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885618944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498529.266228:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885618944:12345-0@lo:400:kworker.0 Request processed in 31us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498529.266235:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789498529.268456:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885619584:0@lo:400:kworker.0 00000100:00100000:2.0:1789498529.268501:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885618944:0@lo:400:kworker.0 00000100:00100000:2.0:1789498529.268516:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885619328:0@lo:400:kworker.0 00000100:00100000:1.0:1789498529.271720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789498529.271738:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885619200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498529.271842:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885619200:12345-0@lo:400:kworker.0 Request processed in 109us (6477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498529.271850:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1789498529.271885:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498529.271891:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498529.271895:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498529.272076:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885619200:0@lo:400:kworker.0 00010000:00010000:3.0:1789498529.707263:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498529.781356:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885619712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498529.781444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498529.782239:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885619712 00000100:00100000:3.0:1789498529.782265:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885619712 00000100:00100000:3.0:1789498529.782341:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789498529.782354:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876424885619712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498529.782411:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498529.783349:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876424885619712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 995us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498529.783644:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789498529.784152:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885619840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498529.784231:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498529.785175:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885619840 00000100:00100000:2.0:1789498529.785198:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885619840 00000100:00100000:2.0:1789498529.785260:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789498529.785271:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885619840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498529.785311:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498529.786568:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876424885619840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1293us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498529.786581:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789498529.786677:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885619840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498529.788229:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885619712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789498530.732537:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789498531.410572:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:3.0:1789498531.760212:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789498531.923148:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789498531.923182:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1789498531.936649:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:1.0:1789498531.936674:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:1.0:1789498531.936694:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98ea84e76cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789498531.936699:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98eababafa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98ea880f7000 00000020:00080000:1.0:1789498531.936703:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98eababaf400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98eabb49f800 00000020:00080000:1.0:1789498531.936731:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1789498531.936747:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1789498531.938364:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789498531.938763:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1789498532.798438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498533.264313:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498533.264349:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498533.264377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498533.264407:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498533.264437:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498533.264497:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864665088 00000100:00100000:1.0:1789498533.264510:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864665088 00000100:00100000:1.0:1789498533.264575:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864665216 00000100:00100000:1.0:1789498533.264579:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864665216 00000100:00100000:1.0:1789498533.264605:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:1.0:1789498533.264617:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864665088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498533.264695:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2356:x1876424864665088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498533.264703:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:1.0:1789498533.264720:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:1.0:1789498533.264726:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864665216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498533.264750:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2356:x1876424864665216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498533.264755:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:1.0:1789498533.264773:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864665344 00000100:00100000:1.0:1789498533.264776:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864665344 00000100:00100000:1.0:1789498533.264798:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864664960 00000100:00100000:1.0:1789498533.264801:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864664960 00000100:00100000:1.0:1789498533.264817:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 177 00000100:00100000:1.0:1789498533.264823:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864665344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498533.264848:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2356:x1876424864665344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498533.264854:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 177 00000100:00100000:1.0:1789498533.264864:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 178 00000100:00100000:1.0:1789498533.264869:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:2356:x1876424864664960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498533.264892:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:2356:x1876424864664960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498533.264904:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 178 00000100:00080000:1.0:1789498533.264926:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498533.264932:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498533.264934:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498533.266729:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864664832 00000100:00100000:2.0:1789498533.266747:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864664832 00000100:00100000:2.0:1789498533.266814:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 304 00000100:00100000:2.0:1789498533.266822:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864664832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498533.266890:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2356:x1876424864664832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498533.266896:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 304 00000100:00100000:1.0:1789498533.802818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498533.802906:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864665472 00000100:00100000:3.0:1789498533.802917:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864665472 00000100:00100000:3.0:1789498533.802976:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 237 00000100:00100000:3.0:1789498533.802987:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11289:x1876424864665472:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789498533.803158:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11289:x1876424864665472:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 Request processed in 173us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498533.803166:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 237 00010000:00010000:3.0:1789498533.803221:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498533.810986:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498533.812768:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864665728 00000100:00100000:0.0:1789498533.812784:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864665728 00000100:00100000:0.0:1789498533.812859:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:0.0:1789498533.812869:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:11289:x1876424864665728:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789498533.813246:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:11289:x1876424864665728:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 377us (2269us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789498533.813254:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:3.0:1789498534.379603:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885620096:0@lo:400:kworker.0 00000100:00100000:3.0:1789498534.379688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498534.379769:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885620608:0@lo:400:kworker.0 00000100:00100000:3.0:1789498534.379796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498534.379838:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498534.379854:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885620224:0@lo:400:kworker.0 00000100:00100000:3.0:1789498534.379882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498534.379921:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885620608 00000100:00100000:3.0:1789498534.379929:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885620608 00000100:00100000:3.0:1789498534.379993:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789498534.380001:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885620608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498534.380053:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885620608:12345-0@lo:400:kworker.0 Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498534.380060:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789498534.380084:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885620096 00000100:00100000:3.0:1789498534.380114:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885620096 00000100:00100000:3.0:1789498534.380139:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885620224 00000100:00100000:3.0:1789498534.380142:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885620224 00000100:00100000:3.0:1789498534.380162:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789498534.380168:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885620096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498534.380199:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885620096:12345-0@lo:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498534.380206:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789498534.380217:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789498534.380223:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885620224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498534.380250:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885620224:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498534.380255:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1789498534.380270:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498534.380275:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498534.380316:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885620224:0@lo:400:kworker.0 00000100:00100000:3.0:1789498534.380327:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885620096:0@lo:400:kworker.0 00000100:00100000:3.0:1789498534.380343:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789498534.380348:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eabaa8e680, transno 4294967322 00000004:00080000:3.0:1789498534.380357:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789498534.380378:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885620608:0@lo:400:kworker.0 00000100:00100000:2.0:1789498534.380763:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885619968:0@lo:400:kworker.0 00000100:00100000:2.0:1789498534.380802:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498534.380832:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885620480:0@lo:400:kworker.0 00000100:00100000:2.0:1789498534.380857:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498534.380876:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498534.380882:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885620352:0@lo:400:kworker.0 00000100:00100000:2.0:1789498534.380905:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498534.380932:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885619968 00000100:00100000:2.0:1789498534.380943:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885619968 00000100:00100000:2.0:1789498534.380975:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789498534.380981:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885619968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498534.381019:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885619968:12345-0@lo:400:kworker.0 Request processed in 38us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498534.381026:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789498534.381063:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885619968:0@lo:400:kworker.0 00000100:00100000:2.0:1789498534.381080:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885620480 00000100:00100000:2.0:1789498534.381083:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885620480 00000100:00100000:2.0:1789498534.381136:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789498534.381143:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885620480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498534.381176:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885620480:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498534.381182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:2.0:1789498534.381196:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498534.381212:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885620480:0@lo:400:kworker.0 00000100:00100000:1.0:1789498534.384006:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885620352 00000100:00100000:1.0:1789498534.384025:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885620352 00000100:00100000:1.0:1789498534.384165:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789498534.384176:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885620352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498534.384293:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885620352:12345-0@lo:400:kworker.0 Request processed in 119us (3386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498534.384300:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789498534.385278:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789498534.385286:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eaba122680, transno 4294967310 00000100:00100000:0.0:1789498534.385310:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885620352:0@lo:400:kworker.0 00000100:00080000:2.0:1789498534.385831:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789498534.827313:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498534.891397:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885620736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498534.891527:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498534.891779:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885620736 00000100:00100000:1.0:1789498534.891788:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885620736 00000100:00100000:1.0:1789498534.891845:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789498534.891855:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885620736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498534.891892:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498534.891950:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885620736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498534.891957:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789498534.892185:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885620864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498534.892218:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498534.892309:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885620864 00000100:00100000:2.0:1789498534.892315:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885620864 00000100:00100000:2.0:1789498534.892347:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789498534.892355:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885620864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498534.892378:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498534.892414:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885620864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498534.892421:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789498534.892768:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885620864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498534.895046:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885620736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498535.851246:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789498536.012043:0:12723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:55:34 (1789498534) 00010000:00010000:0.0:1789498536.879082:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789498537.007390:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789498537.007429:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789498537.007460:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789498537.007496:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789498537.899233:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498538.091480:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789498538.091488:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498538.092212:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789498538.092220:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789498538.389184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498538.389219:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498538.389243:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498538.389261:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498538.389284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498538.389311:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864666112 00000100:00100000:0.0:1789498538.389321:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864666112 00000100:00100000:0.0:1789498538.389374:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864666240 00000100:00100000:0.0:1789498538.389377:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864666240 00000100:00100000:0.0:1789498538.389429:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:0.0:1789498538.389439:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864666112:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498538.389515:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2358:x1876424864666112:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498538.389536:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:0.0:1789498538.389556:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:0.0:1789498538.389563:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2358:x1876424864666240:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498538.390035:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2358:x1876424864666240:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 471us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498538.390043:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:0.0:1789498538.390067:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864666368 00000100:00100000:0.0:1789498538.390071:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864666368 00000100:00100000:0.0:1789498538.390197:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864665984 00000100:00100000:0.0:1789498538.390201:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864665984 00000100:00100000:0.0:1789498538.390225:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 182 00000100:00100000:0.0:1789498538.390232:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864666368:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498538.390261:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:2358:x1876424864666368:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498538.390267:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 182 00000100:00100000:0.0:1789498538.390280:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 183 00000100:00100000:0.0:1789498538.390286:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:2358:x1876424864665984:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498538.390312:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:2358:x1876424864665984:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498538.390318:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 183 00000100:00100000:2.0:1789498538.391184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864665856 00000100:00100000:2.0:1789498538.391194:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864665856 00000100:00100000:2.0:1789498538.391231:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 306 00000100:00100000:2.0:1789498538.391239:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864665856:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498538.391278:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2358:x1876424864665856:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498538.391285:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 306 00000100:00080000:2.0:1789498538.391320:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498538.391324:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498538.391327:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789498538.923760:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498538.985065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498538.985233:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864666496 00000100:00100000:0.0:1789498538.985243:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864666496 00000100:00100000:0.0:1789498538.985313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 238 00000100:00100000:0.0:1789498538.985323:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+5:12297:x1876424864666496:12345-192.168.201.20@tcp:101:lsof.0 00010000:00010000:0.0:1789498538.985345:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498538.985380:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a3a3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498538.985686:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1918d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498538.985703:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1918d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498538.985716:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1918d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498538.985762:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498538.985766:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498538.985810:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1918d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498538.985835:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3a3 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498538.985854:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1918d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3a3 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498538.985872:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:0.0:1789498538.985875:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498538.985892:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5200, rc 0) 00000100:00100000:0.0:1789498538.985957:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:12297:x1876424864666496:12345-192.168.201.20@tcp:101:lsof.0 Request processed in 635us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498538.985965:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 238 00000100:00100000:2.0:1789498539.500447:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885621376:0@lo:400:kworker.0 00000100:00100000:2.0:1789498539.500536:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498539.500626:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789498539.500633:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885620992:0@lo:400:kworker.0 00000100:00100000:2.0:1789498539.500667:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498539.500702:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885621504:0@lo:400:kworker.0 00000100:00100000:2.0:1789498539.500730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498539.500766:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885620992 00000100:00100000:2.0:1789498539.500775:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885620992 00000100:00100000:2.0:1789498539.500825:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789498539.500845:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885620992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498539.500924:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885620992:12345-0@lo:400:kworker.0 Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498539.500932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789498539.500981:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885621504 00000100:00100000:2.0:1789498539.500986:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885621504 00000100:00100000:2.0:1789498539.501030:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789498539.501038:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885621504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498539.501072:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885621504:12345-0@lo:400:kworker.0 Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498539.501078:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:2.0:1789498539.501130:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498539.501161:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885620992:0@lo:400:kworker.0 00000100:00100000:2.0:1789498539.501173:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885621504:0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.501824:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885621120:0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.501882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498539.501924:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885621632:0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.501948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498539.501975:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498539.501982:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885621248:0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.502002:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498539.502049:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885621376 00000100:00100000:3.0:1789498539.502055:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885621376 00000100:00100000:3.0:1789498539.502123:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885621632 00000100:00100000:3.0:1789498539.502126:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885621632 00000100:00100000:3.0:1789498539.502152:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789498539.502159:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885621376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.502206:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885621376:12345-0@lo:400:kworker.0 Request processed in 47us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498539.502213:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789498539.502239:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789498539.502245:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885621632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.502280:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885621632:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498539.502286:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1789498539.502308:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498539.502312:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498539.502336:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885621632:0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.502359:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885621120 00000100:00100000:3.0:1789498539.502375:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885621120 00000100:00100000:3.0:1789498539.502402:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885621248 00000100:00100000:3.0:1789498539.502405:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885621248 00000100:00100000:3.0:1789498539.502442:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789498539.502448:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885621120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.502487:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885621120:12345-0@lo:400:kworker.0 Request processed in 38us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498539.502493:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789498539.502504:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789498539.502510:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885621248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.502534:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885621248:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498539.502540:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:3.0:1789498539.502569:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498539.502590:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885621248:0@lo:400:kworker.0 00000100:00100000:3.0:1789498539.502600:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885621120:0@lo:400:kworker.0 00000100:00100000:2.0:1789498539.503281:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885621376:0@lo:400:kworker.0 00010000:00010000:3.0:1789498539.949564:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498540.011534:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885621760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498540.011630:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498540.011762:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498540.011773:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885621888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498540.011806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498540.011850:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885621760 00000100:00100000:1.0:1789498540.011862:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885621760 00000100:00100000:1.0:1789498540.011923:0:8774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885621888 00000100:00100000:1.0:1789498540.011926:0:8774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885621888 00000100:00100000:1.0:1789498540.011944:0:8774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789498540.011952:0:8774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885621760:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498540.011972:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789498540.011982:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885621888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498540.011998:0:8774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00002000:00000024:2.0:1789498540.012004:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498540.012044:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885621888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498540.012044:0:8774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885621760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498540.012052:0:8774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789498540.012149:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885621760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498540.012149:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885621888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498540.017929:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1789498540.973122:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498541.185952:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498541.186057:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864666752 00000100:00100000:3.0:1789498541.186070:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864666752 00000100:00100000:3.0:1789498541.186193:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:3.0:1789498541.186208:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+18:12299:x1876424864666752:12345-192.168.201.20@tcp:35:umount.0 00000100:00080000:0.0:1789498541.186522:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498541.186928:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:12299:x1876424864666752:12345-192.168.201.20@tcp:35:umount.0 Request processed in 722us (989us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789498541.186939:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:1.0:1789498541.192966:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498541.193079:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864667008 00000100:00100000:0.0:1789498541.193117:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864667008 00000100:00100000:0.0:1789498541.193182:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:0.0:1789498541.193194:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+19:12299:x1876424864667008:12345-192.168.201.20@tcp:35:umount.0 00000100:00100000:0.0:1789498541.193649:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:12299:x1876424864667008:12345-192.168.201.20@tcp:35:umount.0 Request processed in 456us (693us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789498541.193657:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:1.0:1789498541.200226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498541.200520:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864667264 00000100:00100000:3.0:1789498541.200541:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864667264 00000100:00100000:3.0:1789498541.200626:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1789498541.200638:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaa5952c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+20:12299:x1876424864667264:12345-192.168.201.20@tcp:35:umount.0 00000100:00100000:3.0:1789498541.200958:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaa5952c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:12299:x1876424864667264:12345-192.168.201.20@tcp:35:umount.0 Request processed in 322us (745us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789498541.200967:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:2.0:1789498541.208372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498541.209267:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864667520 00000100:00100000:3.0:1789498541.209285:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864667520 00000100:00100000:3.0:1789498541.209384:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:3.0:1789498541.209398:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+21:12299:x1876424864667520:12345-192.168.201.20@tcp:35:umount.0 00000100:00100000:3.0:1789498541.211301:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:12299:x1876424864667520:12345-192.168.201.20@tcp:35:umount.0 Request processed in 1889us (2935us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789498541.211320:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:1.0:1789498541.216871:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498541.216926:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498541.216976:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498541.217078:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864667648 00000100:00100000:2.0:1789498541.217127:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864667648 00000100:00100000:2.0:1789498541.217203:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864667904 00000100:00100000:2.0:1789498541.217230:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864667904 00000100:00100000:2.0:1789498541.217248:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864667776 00000100:00100000:2.0:1789498541.217256:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864667776 00000100:00100000:2.0:1789498541.217284:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:2.0:1789498541.217298:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85660450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+15:2357:x1876424864667648:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498541.217324:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498541.217367:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80031a00/0x3a6cb1946bc181b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f35 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.217392:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498541.217473:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85660450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+14:2357:x1876424864667648:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 178us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498541.217481:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:2.0:1789498541.217693:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1789498541.217701:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+13:2357:x1876424864667904:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498541.217711:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498541.217722:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad24c00/0x3a6cb1946bc183fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a000 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.217732:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498541.217753:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:2357:x1876424864667904:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 53us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498541.217759:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1789498541.217773:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498541.217779:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:2357:x1876424864667776:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498541.217788:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498541.217797:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddfe00/0x3a6cb1946bc18179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99efd expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.217815:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498541.217836:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2357:x1876424864667776:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 56us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498541.217843:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:1.0:1789498541.219296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498541.219397:0:10445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864668288 00000100:00100000:3.0:1789498541.219425:0:10445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864668288 00000100:00100000:3.0:1789498541.219513:0:10445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00080000:0.0:1789498541.219602:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498541.219680:0:10445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2354:x1876424864668288:12345-192.168.201.20@tcp:9:umount.0 00000020:00000080:3.0:1789498541.219726:0:10445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1874c 00000020:00010000:3.0:1789498541.219736:0:10445:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98eaba3b3800: total 0 00000100:00080000:3.0:1789498541.219742:0:10445:0:(import.c:65:import_set_state_nolock()) ffff98eaba3b5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498541.219797:0:10445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1789498541.220200:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98eaba3b3800: total 0 00010000:00010000:2.0:1789498541.220276:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98eaba3b3800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789498541.220368:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61de97b/0x3a6cb1946bc18aef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1d5 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.220418:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f761791/0x3a6cb1946bc1917f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a39c expref: 5 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.220435:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98eaba3b3800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789498541.220458:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498541.220461:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498541.220462:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498541.221552:0:10445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+2:2354:x1876424864668288:12345-192.168.201.20@tcp:9:umount.0 Request processed in 1868us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498541.221569:0:10445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:1.0:1789498541.238588:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498541.238694:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864668416 00000100:00100000:3.0:1789498541.238709:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864668416 00000100:00100000:3.0:1789498541.238808:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:3.0:1789498541.238831:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+5:2354:x1876424864668416:12345-192.168.201.20@tcp:9:umount.0 00000020:00000080:3.0:1789498541.238886:0:6701:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc184eb 00000100:00080000:3.0:1789498541.238900:0:6701:0:(import.c:65:import_set_state_nolock()) ffff98eaba12b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498541.238967:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1789498541.239076:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498541.239408:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+2:2354:x1876424864668416:12345-192.168.201.20@tcp:9:umount.0 Request processed in 587us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498541.239418:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00080000:0.0:1789498541.239578:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498541.253604:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498541.258004:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864669440 00000100:00100000:3.0:1789498541.258031:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864669440 00000100:00100000:3.0:1789498541.258170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 239 00000100:00100000:3.0:1789498541.258184:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+22:2354:x1876424864669440:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:3.0:1789498541.258237:0:5847:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18187 00000020:00010000:3.0:1789498541.258259:0:5847:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98eaba053800: total 0 00000100:00080000:3.0:1789498541.258266:0:5847:0:(import.c:65:import_set_state_nolock()) ffff98eaba057000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1789498541.258389:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98eaba053800: total 0 00010000:00010000:2.0:1789498541.258396:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789498541.258410:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00010000:00010000:2.0:1789498541.258461:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98eaba053800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789498541.258506:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98eaa1d46a00) 00010000:00010000:2.0:1789498541.258511:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498541.258522:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24a00/0x3a6cb1946bc1846d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a015 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258552:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498541.258562:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498541.258568:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc18e3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a2c3 expref: 20 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258585:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498541.258588:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498541.258593:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19060 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a34f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258606:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98ea84ebfc00) 00010000:00010000:2.0:1789498541.258609:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789498541.258612:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc18b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1f1 expref: 18 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258632:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498541.258635:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498541.258639:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc18ab0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1c0 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258651:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498541.258653:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498541.258670:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc187ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a0fc expref: 16 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258686:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98eaa1d46700) 00010000:00010000:2.0:1789498541.258689:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498541.258693:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25a00/0x3a6cb1946bc18451 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a00e expref: 15 pid: 7250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258726:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498541.258729:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789498541.258733:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac20db000/0x3a6cb1946bc18ada lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ce expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258750:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498541.258753:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789498541.258756:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc1916a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a395 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258770:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98eaa1d46100) 00010000:00010000:2.0:1789498541.258772:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498541.258775:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25800/0x3a6cb1946bc189d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a188 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258792:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98ea9108c900) 00010000:00010000:2.0:1789498541.258795:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498541.258810:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea91099000/0x3a6cb1946bc19140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a387 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258830:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98ea84ebfa00) 00010000:00010000:2.0:1789498541.258832:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789498541.258836:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc184c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a02a expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258851:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:2.0:1789498541.258853:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498541.258864:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddec00/0x3a6cb1946bc18b43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a1ea expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498541.258877:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98eaba053800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789498541.258898:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498541.258901:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498541.258902:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498541.259361:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0953f915-6ba0-4bbb-8a03-cecc9ebbc14c+7:2354:x1876424864669440:12345-192.168.201.20@tcp:39:umount.0 Request processed in 1179us (5776us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789498541.259372:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 239 00000001:00100000:2.0:1789498541.718775:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:2.0:1789498541.718801:0:6726:0:(genops.c:885:class_export_put()) final put ffff98eaba12e000/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:2.0:1789498541.719775:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba12e000/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c for lustre-OST0000 00000020:00000080:2.0:1789498541.720354:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98eaba12b000 for lustre-OST0000 00010000:00010000:2.0:1789498541.995403:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789498542.132923:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:3.0:1789498542.132955:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000001:00080000:3.0:1789498542.132964:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1789498542.132986:0:5867:0:(genops.c:885:class_export_put()) final put ffff98eaba053800/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:1.0:1789498542.133049:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba053800/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c for lustre-MDT0000 00000020:00000080:1.0:1789498542.133180:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98eaba057000 for lustre-MDT0000 00000001:00100000:1.0:1789498542.163686:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:1.0:1789498542.163705:0:7653:0:(genops.c:885:class_export_put()) final put ffff98eaba3b3800/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c 00000020:00000080:2.0:1789498542.163942:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba3b3800/0953f915-6ba0-4bbb-8a03-cecc9ebbc14c for lustre-OST0001 00000020:00000080:2.0:1789498542.164017:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98eaba3b5000 for lustre-OST0001 00010000:00010000:2.0:1789498543.021273:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498543.498609:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498543.498661:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498543.498702:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498543.498793:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864669696 00000100:00100000:3.0:1789498543.498809:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864669696 00000100:00100000:3.0:1789498543.498890:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864669568 00000100:00100000:3.0:1789498543.498893:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864669568 00000100:00100000:3.0:1789498543.498907:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864669824 00000100:00100000:3.0:1789498543.498909:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864669824 00000100:00100000:3.0:1789498543.498928:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:3.0:1789498543.498939:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+12:2357:x1876424864669696:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498543.498960:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498543.498987:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640f800/0x3a6cb1946bc18260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f74 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498543.499012:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498543.499147:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+11:2357:x1876424864669696:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 209us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498543.499155:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:3.0:1789498543.499175:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:3.0:1789498543.499181:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+10:2357:x1876424864669568:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498543.499190:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498543.499200:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad24200/0x3a6cb1946bc18259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f4a expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498543.499209:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498543.499244:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+9:2357:x1876424864669568:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 63us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498543.499252:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:3.0:1789498543.499264:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1789498543.499270:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+8:2357:x1876424864669824:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498543.499278:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498543.499286:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad24800/0x3a6cb1946bc183f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99ff9 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498543.499306:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498543.499323:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+7:2357:x1876424864669824:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 53us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498543.499329:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1789498543.508150:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498543.508595:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864669952 00000100:00100000:2.0:1789498543.508611:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864669952 00000100:00100000:2.0:1789498543.508720:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 187 00000100:00100000:2.0:1789498543.508733:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:2358:x1876424864669952:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498543.508854:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:2358:x1876424864669952:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 124us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498543.508863:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 187 00000100:00080000:0.0:1789498543.509343:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498543.512031:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498543.512177:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864670208 00000100:00100000:3.0:1789498543.512192:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864670208 00000100:00100000:3.0:1789498543.512277:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 240 00000100:00100000:3.0:1789498543.512289:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+6:2354:x1876424864670208:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:3.0:1789498543.512362:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1826e 00000020:00010000:3.0:1789498543.512376:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98e98454d000: total 0 00000100:00080000:3.0:1789498543.512382:0:5845:0:(import.c:65:import_set_state_nolock()) ffff98e98454a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498543.512426:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1789498543.512905:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98e98454d000: total 0 00010000:00010000:0.0:1789498543.512970:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e98454d000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789498543.513017:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea930e1700) 00010000:00010000:0.0:1789498543.513021:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498543.513034:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc1918d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3a3 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498543.513065:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e98454d000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789498543.513076:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498543.513078:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498543.513080:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498543.513536:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e986cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aabb82d-9fed-48aa-9509-748e4c2edaf4+3:2354:x1876424864670208:12345-192.168.201.20@tcp:39:umount.0 Request processed in 1246us (1519us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789498543.513546:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 240 00000100:00100000:1.0:1789498543.527996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498543.528157:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864670464 00000100:00100000:0.0:1789498543.528173:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864670464 00000100:00100000:0.0:1789498543.528268:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 308 00000100:00100000:0.0:1789498543.528279:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+7:2354:x1876424864670464:12345-192.168.201.20@tcp:251:umount.0 00000020:00000080:0.0:1789498543.528358:0:5837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18164 00000020:00010000:0.0:1789498543.528370:0:5837:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98e987725800: total 0 00000100:00080000:0.0:1789498543.528378:0:5837:0:(import.c:65:import_set_state_nolock()) ffff98e987727000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789498543.528497:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea+3:2354:x1876424864670464:12345-192.168.201.20@tcp:251:umount.0 Request processed in 219us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498543.528505:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 308 00000020:00010000:3.0:1789498543.528717:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98e987725800: total 0 00010000:00010000:3.0:1789498543.528726:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498543.528808:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e987725800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789498543.528867:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac20da000/0x3a6cb1946bc181b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a99f3c expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498543.528887:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e987725800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789498543.528895:0:5834:0:(genops.c:885:class_export_put()) final put ffff98e987725800/5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea 00010000:00010000:3.0:1789498543.528918:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498543.528920:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498543.528922:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789498543.530949:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e987725800/5ff2f185-e4f1-4e4e-bba0-78dccf6f47ea for MGS 00000020:00000080:0.0:1789498543.531034:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e987727000 for MGS 00010000:00010000:2.0:1789498544.043817:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498544.627533:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885622016:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.627641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498544.627702:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885622528:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.627738:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498544.627771:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498544.627777:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885622400:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.627806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498544.627843:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885622144:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.627870:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498544.627888:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885622656:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.627909:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498544.627928:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498544.627933:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885622272:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.627957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498544.627995:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885622016 00000100:00100000:3.0:1789498544.628005:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885622016 00000100:00100000:3.0:1789498544.628063:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789498544.628074:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885622016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628169:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8575b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885622016:12345-0@lo:400:kworker.0 Request processed in 94us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498544.628178:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789498544.628218:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885622528 00000100:00100000:3.0:1789498544.628222:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885622528 00000100:00100000:3.0:1789498544.628263:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885622144 00000100:00100000:3.0:1789498544.628266:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885622144 00000100:00100000:3.0:1789498544.628292:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885622272 00000100:00100000:3.0:1789498544.628296:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885622272 00000100:00100000:3.0:1789498544.628314:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789498544.628322:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885622528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628360:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885622528:12345-0@lo:400:kworker.0 Request processed in 39us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498544.628367:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789498544.628379:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789498544.628385:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885622144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628418:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885622144:12345-0@lo:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498544.628424:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789498544.628435:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789498544.628442:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885622272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628469:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885622272:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498544.628475:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789498544.628494:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885622400 00000100:00100000:3.0:1789498544.628497:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885622400 00000100:00100000:3.0:1789498544.628525:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885622656 00000100:00100000:3.0:1789498544.628535:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885622656 00000100:00100000:3.0:1789498544.628562:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789498544.628570:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885622400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628605:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885622400:12345-0@lo:400:kworker.0 Request processed in 36us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498544.628612:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789498544.628623:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789498544.628629:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885622656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628660:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885622656:12345-0@lo:400:kworker.0 Request processed in 31us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498544.628666:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789498544.628849:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885622272:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628863:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885622144:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628872:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885622656:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628908:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885622400:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628919:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885622016:0@lo:400:kworker.0 00000100:00100000:3.0:1789498544.628929:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885622528:0@lo:400:kworker.0 00000100:00080000:0.0:1789498544.629158:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498544.629165:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498544.629168:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498545.067279:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498545.132149:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498545.132182:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885622784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498545.132306:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498545.132412:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885622784 00000100:00100000:0.0:1789498545.132423:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885622784 00000100:00100000:0.0:1789498545.132496:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789498545.132508:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885622784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498545.132570:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498545.132625:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885622784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498545.132634:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789498545.132701:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885622784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498545.133238:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885622912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498545.133303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498545.133396:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885622912 00000100:00100000:2.0:1789498545.133402:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885622912 00000100:00100000:2.0:1789498545.133448:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789498545.133457:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885622912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498545.133492:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498545.133543:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885622912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498545.133551:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789498545.133590:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885622912:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1789498545.378853:0:12924:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789498545.403705:0:12924:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789498545.403779:0:12924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.403822:0:12924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.403830:0:12924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.403837:0:12924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.403870:0:12924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789498545.403876:0:12924:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789498545.403905:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498545.403910:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789498545.403918:0:12924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789498545.403954:0:12924:0:(import.c:65:import_set_state_nolock()) ffff98eac1bbc800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789498545.404016:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885623040:0@lo:39:umount.0 00000100:00100000:3.0:1789498545.404130:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498545.404224:0:7250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885623040 00000100:00100000:3.0:1789498545.404232:0:7250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885623040 00000100:00100000:3.0:1789498545.404296:0:7250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789498545.404307:0:7250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876424885623040:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789498545.404339:0:7250:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17f73 00000100:00080000:3.0:1789498545.404349:0:7250:0:(import.c:65:import_set_state_nolock()) ffff98eac1bf6800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789498545.404411:0:7250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1876424885623040:12345-0@lo:39:umount.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498545.404418:0:7250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789498545.404429:0:7250:0:(genops.c:885:class_export_put()) final put ffff98eac1bf5000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789498545.404469:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498545.404477:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.404486:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498545.404490:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.404501:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498545.404509:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498545.404515:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789498545.404518:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789498545.404521:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789498545.404549:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.404556:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498545.404586:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.404594:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80030600/0x3a6cb1946bc181f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc181fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498545.404608:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498545.404610:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498545.404611:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789498545.404623:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac1bf5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789498545.404694:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98eac1bf6800 for lustre-MDT0000 00000100:00080000:3.0:1789498545.404735:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98eac1bbc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789498545.404746:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885623040:0@lo:39:umount.0 00000100:00080000:3.0:1789498545.404768:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498545.404770:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789498545.404774:0:12924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789498545.404886:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498545.404921:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885623168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498545.404965:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498545.405055:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885623168 00000100:00100000:1.0:1789498545.405060:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885623168 00000100:00100000:1.0:1789498545.405130:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498545.405140:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3308:x1876424885623168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498545.405169:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498545.405193:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554e00/0x3a6cb1946bc181fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc181f7 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.405211:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498545.405249:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:3308:x1876424885623168:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498545.405266:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498545.405303:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885623168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498545.405925:0:12924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.405938:0:12924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.405946:0:12924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.405954:0:12924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.405994:0:12924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498545.406002:0:12924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406009:0:12924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406016:0:12924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406022:0:12924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406038:0:12924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789498545.406048:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789498545.406054:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406062:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac20dac00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498545.406066:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406076:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498545.406084:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498545.406121:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789498545.406130:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789498545.406160:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406167:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498545.406191:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406199:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20dac00/0x3a6cb1946bc18205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc1820c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406213:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498545.406216:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406222:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde200 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498545.406225:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406232:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498545.406238:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498545.406244:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789498545.406246:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789498545.406248:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789498545.406272:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406280:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498545.406293:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406301:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1811e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc18125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406316:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498545.406318:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498545.406320:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498545.406334:0:12924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406342:0:12924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406348:0:12924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406354:0:12924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406365:0:12924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498545.406371:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498545.406375:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406382:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25e00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498545.406385:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406391:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498545.406405:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498545.406410:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789498545.406412:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789498545.406414:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789498545.406428:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406434:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498545.406448:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406454:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad25e00/0x3a6cb1946bc18420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc18427 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406462:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498545.406464:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498545.406465:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498545.406482:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885623552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498545.406547:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789498545.406618:0:12924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406627:0:12924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406633:0:12924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406650:0:12924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406661:0:12924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789498545.406666:0:12924:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789498545.406670:0:12924:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1789498545.406703:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498545.406707:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406713:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab640f600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498545.406715:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.406722:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498545.406728:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498545.406733:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789498545.406736:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789498545.406737:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1789498545.406930:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885623296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498545.406977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498545.407005:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498545.407011:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885623424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498545.407033:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498545.407070:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885623552 00000100:00100000:0.0:1789498545.407078:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885623552 00000100:00100000:0.0:1789498545.407151:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885623296 00000100:00100000:0.0:1789498545.407155:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885623296 00000100:00100000:0.0:1789498545.407167:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885623424 00000100:00100000:0.0:1789498545.407169:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885623424 00000100:00100000:0.0:1789498545.407184:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789498545.407193:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85662450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+20:3307:x1876424885623552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498545.407209:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498545.407225:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad25000/0x3a6cb1946bc18427 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc18420 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498545.407240:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498545.407290:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85662450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+19:3307:x1876424885623552:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498545.407299:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789498545.407355:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789498545.407362:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+18:3305:x1876424885623296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498545.407370:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498545.407380:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc1820c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc18205 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498545.407390:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498545.407416:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+17:3305:x1876424885623296:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498545.407430:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789498545.407445:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789498545.407452:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+16:3305:x1876424885623424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498545.407461:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498545.407471:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80030400/0x3a6cb1946bc18125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc1811e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498545.407485:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498545.407507:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:3305:x1876424885623424:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498545.407514:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789498545.407563:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885623424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498545.407573:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885623296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498545.407601:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec95aa81-4721-4a06-ac30-039c6a8f6732:3307:1876424885623552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498545.407869:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.407877:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498545.407897:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.407916:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab640f600/0x3a6cb1946bc17ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc17ed9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498545.407931:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498545.407934:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498545.407935:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498545.407948:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885623680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498545.407978:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789498545.408019:0:12924:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789498545.408025:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789498545.408031:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498545.408037:0:12924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1789498545.408043:0:12924:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98eababbc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789498545.408049:0:12924:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98ea89104000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789498545.408059:0:12924:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff98e98454d000 1aabb82d-9fed-48aa-9509-748e4c2edaf4 192.168.201.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789498545.408065:0:12924:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff98ea875eb380) has exports, disconnecting them 00000020:00080000:1.0:1789498545.408070:0:12924:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98eababbc000), last request at 1789498544 00000020:00000080:1.0:1789498545.408080:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc180e6 00000100:00080000:1.0:1789498545.408121:0:12924:0:(import.c:65:import_set_state_nolock()) ffff98eababb8000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789498545.408171:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789498545.408186:0:12924:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98eababbc000): rc 0 00000020:00000080:1.0:1789498545.408189:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eababbc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789498545.408201:0:12924:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98ea89104000), last request at 1789498544 00000020:00000080:1.0:1789498545.408205:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1801b 00000100:00080000:1.0:1789498545.408210:0:12924:0:(import.c:65:import_set_state_nolock()) ffff98ea89100000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789498545.408225:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eababbc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789498545.408293:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98eababb8000 for lustre-MDT0000 00010000:00010000:1.0:1789498545.408303:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789498545.408312:0:12924:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98ea89104000): rc 0 00000020:00000080:1.0:1789498545.408314:0:12924:0:(genops.c:885:class_export_put()) final put ffff98ea89104000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789498545.408326:0:12924:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba75c1c97ae0 00000020:00000080:1.0:1789498545.408338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea89104000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789498545.408368:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea89100000 for lustre-MDT0000 00000100:00080000:1.0:1789498545.408393:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789498545.408397:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789498545.408417:0:12924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789498545.408488:0:12924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789498545.408503:0:12924:0:(import.c:65:import_set_state_nolock()) ffff98ea891bf000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789498545.408516:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789498545.408518:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1789498545.408529:0:12924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789498545.408595:0:12924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789498545.408604:0:12924:0:(import.c:65:import_set_state_nolock()) ffff98e987723000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789498545.408639:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff98ea875eb380) has no exports 00010000:00010000:3.0:1789498545.408721:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498545.408773:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885623808:0@lo:9:umount.0 00000100:00100000:3.0:1789498545.408822:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498545.408851:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885623936:0@lo:9:umount.0 00000100:00100000:3.0:1789498545.408878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498545.408925:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885623808 00000100:00100000:3.0:1789498545.408934:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885623808 00000100:00100000:3.0:1789498545.409174:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885623936 00000100:00100000:3.0:1789498545.409179:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885623936 00000100:00100000:3.0:1789498545.409209:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789498545.409220:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876424885623808:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789498545.409254:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18068 00000100:00080000:3.0:1789498545.409272:0:6702:0:(import.c:65:import_set_state_nolock()) ffff98ea89103800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498545.409324:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789498545.415902:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1876424885623808:12345-0@lo:9:umount.0 Request processed in 6665us (7060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498545.415922:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789498545.415970:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789498545.415988:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876424885623936:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789498545.416032:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1814f 00000100:00080000:3.0:1789498545.416049:0:6702:0:(import.c:65:import_set_state_nolock()) ffff98ea891ba800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498545.416130:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789498545.416393:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1876424885623936:12345-0@lo:9:umount.0 Request processed in 413us (7513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498545.416400:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1789498545.416805:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498545.416831:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498545.416881:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea891bf000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789498545.416891:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789498545.416894:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498545.416899:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885623808:0@lo:9:umount.0 00000100:00080000:3.0:1789498545.416914:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e987723000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789498545.416920:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789498545.416922:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498545.416924:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885623936:0@lo:9:umount.0 00000100:00100000:0.0:1789498545.417601:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885623680 00000100:00100000:0.0:1789498545.417615:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885623680 00000100:00100000:0.0:1789498545.417740:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789498545.417765:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+15:3308:x1876424885623680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498545.417785:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498545.417812:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6555a00/0x3a6cb1946bc17ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc17ed2 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498545.417835:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498545.417897:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec95aa81-4721-4a06-ac30-039c6a8f6732+14:3308:x1876424885623680:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (9918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498545.417918:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789498545.417973:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885623680:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789498545.435538:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff98ea875eb380) has no exports 00000020:00000080:0.0:1789498545.514263:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17f2d 00000020:00000080:0.0:1789498545.514284:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eab971c800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789498545.514302:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789498545.514335:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eab971c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789498545.514405:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498545.514423:0:12924:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789498545.514430:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff98eabb55cd40) has no exports 00000020:00000080:1.0:1789498545.515086:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17f26 00000020:00000080:1.0:1789498545.515349:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eabd51b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789498545.515653:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabd51b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789498545.515777:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498545.515792:0:12924:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789498545.515796:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eabb3e6000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789498545.515800:0:12924:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabb3e6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789498545.515806:0:12924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1789498546.091323:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789498546.740460:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789498546.740476:0:6726:0:(genops.c:885:class_export_put()) final put ffff98ea89105000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789498546.740562:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea89105000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789498546.740628:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea89103800 for lustre-OST0000 00010000:00010000:3.0:1789498547.115398:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789498547.257521:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aabb82d-9fed-48aa-9509-748e4c2edaf4 00000001:00080000:1.0:1789498547.257563:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789498547.257570:0:5867:0:(genops.c:885:class_export_put()) final put ffff98e98454d000/1aabb82d-9fed-48aa-9509-748e4c2edaf4 00000020:00000080:1.0:1789498547.257598:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e98454d000/1aabb82d-9fed-48aa-9509-748e4c2edaf4 for lustre-MDT0000 00000020:00000080:1.0:1789498547.257677:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e98454a800 for lustre-MDT0000 00000001:00100000:2.0:1789498547.274352:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789498547.274368:0:7653:0:(genops.c:885:class_export_put()) final put ffff98ea891b8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789498547.274504:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea891b8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789498547.274572:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea891ba800 for lustre-OST0001 00000020:01000000:1.0:1789498547.563370:0:12924:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea9f719c00 - data ffff98ea9cb3ce58/ffff98eabafa6400 00000020:01000000:1.0:1789498547.563555:0:12924:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea910d5c00 - data ffff98eab1308a20/ffff98eabd52d400 00000001:00000004:1.0:1789498547.574240:0:12924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1789498547.683315:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789498547.683331:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789498547.683373:0:12924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498547.683378:0:12924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789498547.684640:0:6872:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789498547.684650:0:6872:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789498547.684666:0:6872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789498547.687792:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789498547.687804:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789498547.687832:0:12924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498547.687835:0:12924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789498547.688495:0:7999:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789498547.688501:0:7999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789498547.688514:0:7999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789498547.777775:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17ef5 00000020:00000080:0.0:1789498547.777795:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eac0ae0000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789498547.778510:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0ae0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789498547.782325:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17f0a 00000020:00000080:3.0:1789498547.782348:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eabb3e7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789498547.782371:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789498547.782392:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498547.782403:0:12924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789498547.782408:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff98ea875ecd40) has no exports 00000004:01000000:3.0:1789498547.782641:0:12924:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789498547.782653:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18148 00000020:00000080:3.0:1789498547.782659:0:12924:0:(genops.c:885:class_export_put()) final put ffff98e98441e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789498547.782664:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789498547.782669:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498547.782677:0:12924:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789498547.782680:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff98e98443cd40) has no exports 00000020:00000080:3.0:1789498547.782688:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18141 00000020:00000080:3.0:1789498547.782693:0:12924:0:(genops.c:885:class_export_put()) final put ffff98e987726000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789498547.783123:0:12924:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789498547.783130:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789498547.783135:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1789498547.783143:0:12924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498547.783147:0:12924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789498547.783186:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498547.783195:0:12924:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789498547.783202:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18061 00000020:00000080:3.0:1789498547.783208:0:12924:0:(genops.c:885:class_export_put()) final put ffff98e9847f3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789498547.783212:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789498547.783225:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498547.783230:0:12924:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789498547.783232:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff98ea83f7cd40) has no exports 00000020:00000080:3.0:1789498547.783237:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1805a 00000020:00000080:3.0:1789498547.783241:0:12924:0:(genops.c:885:class_export_put()) final put ffff98ea891bd000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789498547.783580:0:12924:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789498547.783584:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789498547.783586:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789498547.783590:0:12924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498547.783592:0:12924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789498547.783639:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498547.783645:0:12924:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789498547.783680:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498547.783683:0:12924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789498547.783719:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17f11 00000020:00000080:3.0:1789498547.783725:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eabb3e6800/lustre-MDD0000_UUID 00000020:01000000:3.0:1789498547.783729:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789498547.783732:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498547.783736:0:12924:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789498547.783738:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff98eabb558000) has no exports 00000020:00000080:3.0:1789498547.783763:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498547.783766:0:12924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789498547.783770:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17f18 00000020:00000080:3.0:1789498547.783773:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eabb3e1000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789498547.783782:0:12924:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98ea90a2f000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789498547.783786:0:12924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98ea90a2f000 3 00000020:01000004:3.0:1789498547.783790:0:12924:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98ea90a2f000 from lustre-MDT0000 00000020:00000080:3.0:1789498547.783813:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498547.783816:0:12924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789498547.783819:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eac0ae4000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789498547.783822:0:12924:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0ae4000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789498547.783833:0:12924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789498547.783924:0:12924:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789498547.783929:0:12924:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789498547.783932:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789498547.783935:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498547.783938:0:12924:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789498547.783948:0:12924:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff98ea83f8b800 ec95aa81-4721-4a06-ac30-039c6a8f6732 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789498547.783953:0:12924:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff98ea875e8000) has exports, disconnecting them 00000020:00080000:3.0:1789498547.783958:0:12924:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98ea83f8b800), last request at 1789498297 00000020:00000080:3.0:1789498547.783978:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17eb6 00000020:00010000:3.0:1789498547.783984:0:12924:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98ea83f8b800: total 7 00000100:00080000:3.0:1789498547.783996:0:12924:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789498547.784028:0:12924:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98ea83f8b800): rc 0 00000020:00080000:3.0:1789498547.784033:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff98ea875e8000) has no exports 00000100:00100000:3.0:1789498547.784161:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff98ea85748400:5839] 1 exiting: rc = 0 00000020:00010000:1.0:1789498547.784418:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98ea83f8b800: total 7 00010000:00010000:1.0:1789498547.784464:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98ea83f8b800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789498547.784503:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc181c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc181bf expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498547.784525:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddfa00/0x3a6cb1946bc181e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc181db expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498547.784537:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80031c00/0x3a6cb1946bc181d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc181cd expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498547.784549:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad25600/0x3a6cb1946bc1840b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc18404 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498547.784560:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80030e00/0x3a6cb1946bc181f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc181e9 expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498547.784584:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea80031400/0x3a6cb1946bc1821a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc18213 expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498547.784600:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad24400/0x3a6cb1946bc18419 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc18412 expref: 3 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498547.784615:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab640ec00/0x3a6cb1946bc17fce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc17fc7 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498547.784631:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98ea83f8b800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789498547.784645:0:5834:0:(genops.c:885:class_export_put()) final put ffff98ea83f8b800/ec95aa81-4721-4a06-ac30-039c6a8f6732 00010000:00010000:1.0:1789498547.784654:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498547.784656:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498547.784658:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498547.784950:0:5837:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff98ea8574be00:5837] 0 exiting: rc = 1 00000020:00000080:0.0:1789498547.785011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabb3e7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789498547.785018:0:36:0:(genops.c:885:class_export_put()) final put ffff98eac0ae6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789498547.785020:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0ae6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789498547.785025:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498547.785238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e98441e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789498547.785247:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e987726000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789498547.785255:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e987723000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789498547.785262:0:36:0:(genops.c:885:class_export_put()) final put ffff98e98441c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789498547.785264:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e98441c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789498547.785268:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498547.785311:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e9847f3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789498547.785319:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea891bd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789498547.785326:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea891bf000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789498547.785331:0:36:0:(genops.c:885:class_export_put()) final put ffff98e9847f0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789498547.785334:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e9847f0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789498547.785339:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498547.785418:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabb3e6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789498547.785438:0:36:0:(genops.c:885:class_export_put()) final put ffff98eabb3e5800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789498547.785440:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabb3e5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789498547.785444:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789498547.785687:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabb3e1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789498547.785692:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea83f8b800/ec95aa81-4721-4a06-ac30-039c6a8f6732 for MGS 00000020:00000080:0.0:1789498547.785754:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea83f8d000 for MGS 00000100:00100000:2.0:1789498547.786372:0:5840:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff98ea8574b400:5840] 2 exiting: rc = 0 00000100:00100000:3.0:1789498547.786862:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786874:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786886:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786893:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786901:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786910:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786917:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786924:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786931:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786939:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786946:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786952:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786959:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786965:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786972:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786979:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786986:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786993:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.786999:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787006:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787012:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787019:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787025:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787033:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787039:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787046:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787053:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787059:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787065:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787071:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787632:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787642:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787648:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787654:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787660:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787666:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787673:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787679:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787685:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787691:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787698:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787714:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787723:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787728:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787734:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787740:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787747:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787752:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787758:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787764:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787770:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787776:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787782:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787788:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787793:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787799:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787805:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787811:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787817:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787823:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787829:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787835:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787843:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498547.787849:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1789498547.788632:0:12924:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789498547.788647:0:12924:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1789498547.789846:0:12924:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea8510a8a0 - data ffff98eab83171b0/ffff98e985b6c000 00000020:01000000:3.0:1789498547.790024:0:12924:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea85452e40 - data ffff98eab1387a20/ffff98ea8503d800 00000020:00000080:3.0:1789498547.791671:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17e9a 00000020:00000080:3.0:1789498547.791686:0:12924:0:(genops.c:885:class_export_put()) final put ffff98ea85c35000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789498547.791731:0:12924:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98ea90a2f000 from MGS, refs=2 00000020:01000004:3.0:1789498547.791736:0:12924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98ea90a2f000 2 00000020:01000004:3.0:1789498547.791740:0:12924:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98ea90a2f000 from MGS 00000020:00000080:3.0:1789498547.791775:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498547.791785:0:12924:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789498547.791788:0:12924:0:(genops.c:885:class_export_put()) final put ffff98ea910a4000/MGS 00000020:00000080:3.0:1789498547.791791:0:12924:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea910a4000/MGS for MGS 00000020:01000000:3.0:1789498547.791800:0:12924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789498547.791880:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789498547.791885:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498547.791891:0:12924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789498547.791901:0:12924:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98eac1bbf000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789498547.791908:0:12924:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff98ea83f2cd40) has exports, disconnecting them 00000020:00080000:3.0:1789498547.791914:0:12924:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98eac1bbf000), last request at 1789498298 00000020:00000080:3.0:1789498547.791920:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17f65 00000020:00080000:3.0:1789498547.791931:0:12924:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98eac1bbf000): rc 0 00000020:00000080:3.0:1789498547.791938:0:12924:0:(genops.c:885:class_export_put()) final put ffff98eac1bbf000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789498547.794201:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea85c35000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789498547.794239:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac1bbf000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789498547.796203:0:12924:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789498547.796221:0:12924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789498547.796227:0:12924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789498547.796237:0:12924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789498547.796481:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498547.796493:0:12924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789498547.796502:0:12924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98ea90a2f000 1 00000020:00000080:0.0:1789498547.796511:0:12924:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17e8c 00000020:00000080:0.0:1789498547.796522:0:12924:0:(genops.c:885:class_export_put()) final put ffff98ea910a1000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789498547.796529:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789498547.796534:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498547.796539:0:12924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789498547.796543:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff98ea875e99c0) has no exports 00000020:00000080:1.0:1789498547.796792:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98eac1bbc800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789498547.796801:0:37:0:(genops.c:885:class_export_put()) final put ffff98eac1bbd000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789498547.796804:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac1bbd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789498547.796822:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789498547.796913:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea910a1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789498547.844462:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498547.844491:0:12924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789498547.844502:0:12924:0:(genops.c:885:class_export_put()) final put ffff98ea90a28800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789498547.844509:0:12924:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea90a28800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789498547.844525:0:12924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789498547.844734:0:12924:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98ea90a2f800 00000020:01000000:0.0:1789498547.844760:0:12924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789498547.844764:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498547.844768:0:12924:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789498547.844785:0:12924:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff98ea83f7b380) has no exports 00000100:00100000:3.0:1789498547.848555:0:5845:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff98ea83f0a000:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1789498547.848778:0:5847:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff98ea8917ac00:5847] 2 exiting: rc = 0 00000100:00100000:3.0:1789498547.848862:0:7250:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff98eababa3000:7250] 3 exiting: rc = 0 00000100:00100000:3.0:1789498547.849006:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff98ea8917b400:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1789498547.849370:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849381:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849389:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849398:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849405:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849412:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849419:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849428:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849439:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849447:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849455:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849462:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849469:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849475:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849482:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849489:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849496:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849502:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849509:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849516:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849524:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849530:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849536:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849544:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849551:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849560:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849567:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849573:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849581:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849588:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849595:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849601:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849608:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849615:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849644:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849651:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849657:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849664:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849672:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849680:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849689:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.849697:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851542:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851561:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851568:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851575:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851582:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851589:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851596:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851603:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851610:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851617:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851623:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851629:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851635:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851642:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851650:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851656:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851663:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851670:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851677:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851684:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851691:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.851761:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.861487:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98ea8917ae00:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1789498547.862370:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98ea9109c000:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1789498547.862613:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862624:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862633:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862641:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862648:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862655:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862663:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862670:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862677:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862715:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862723:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862729:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862737:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862744:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862751:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862757:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862763:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862769:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862775:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862781:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862788:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862794:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862801:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862807:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862813:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862819:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862825:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862830:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862837:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862843:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862849:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862855:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862861:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862867:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862873:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862878:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862885:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862893:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862899:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862905:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862911:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862916:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862922:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862928:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862942:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862948:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862954:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862959:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862965:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862971:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862979:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862984:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862990:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.862995:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863002:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863009:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863014:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863021:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863027:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863033:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863039:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863045:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863051:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863058:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863657:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff98ea83f91a00:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1789498547.863774:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff98ea9f6bfc00:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1789498547.863832:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863842:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863851:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863859:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863866:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863874:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863881:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863900:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863909:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863915:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863922:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863929:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863937:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863954:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863962:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863968:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863975:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863982:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.863988:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864010:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864018:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864024:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864031:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864039:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864045:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864051:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864058:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864065:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864071:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864077:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864084:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864131:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864141:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864148:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864156:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864163:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864170:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864177:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864184:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864192:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864199:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864205:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864225:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864250:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864258:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864265:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864272:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864280:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864295:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864302:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864311:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864319:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864326:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864333:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864340:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864363:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864372:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864379:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864388:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864396:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864407:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864418:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864425:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.864434:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.880040:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98ea82fcc200:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1789498547.880314:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98ea833bd400:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1789498547.880839:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880850:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880856:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880862:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880869:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880875:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880881:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880888:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880893:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880899:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880906:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880911:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880917:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880922:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880928:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880934:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880940:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880947:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880953:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880978:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880984:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880990:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.880996:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881002:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881007:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881013:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881019:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881025:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881030:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881036:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881042:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881047:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881053:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881059:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881066:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881072:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881078:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881083:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881116:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881124:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881130:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881135:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881141:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881147:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881153:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881159:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881166:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881172:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881178:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881184:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881190:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881196:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881202:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881208:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881233:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881240:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881247:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881252:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881258:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881264:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881270:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881277:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881292:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881299:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.881810:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98ea82fc8c00:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1789498547.882118:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98ea833b9a00:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1789498547.882230:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882238:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882245:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882251:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882257:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882264:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882270:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882277:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882337:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882344:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882349:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882355:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882361:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882366:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882372:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882377:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882382:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882387:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882392:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882397:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882401:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882406:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882412:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882417:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882434:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882439:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882445:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882450:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882455:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882461:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882466:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882472:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882478:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882483:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882489:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882495:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882501:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882506:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882512:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882517:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882523:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882528:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882535:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882540:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882545:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882550:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882555:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882561:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882567:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882572:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882578:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882583:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882588:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882592:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882599:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882604:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882609:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882615:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882620:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882629:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882635:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882639:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882644:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.882649:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.883607:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff98ea833b8800:5856] 0 exiting: rc = 1 00000100:00100000:2.0:1789498547.883922:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff98ea82fc9800:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1789498547.884367:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884376:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884383:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884389:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884395:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884401:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884407:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884413:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884419:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884426:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884432:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884437:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884443:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884448:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884455:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884461:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884466:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884473:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884480:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884486:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884492:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884498:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884504:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884511:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884517:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884523:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884529:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884535:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884541:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884547:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884569:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884574:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884579:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884585:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884591:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884597:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884602:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884608:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884615:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884622:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884629:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884636:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884642:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884651:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884658:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884663:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884670:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884677:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884682:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884688:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884694:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884699:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884715:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884721:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884727:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884733:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884740:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884745:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884752:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884757:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884763:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884770:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884776:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.884782:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498547.885629:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff98ea82fc8200:5858] 0 exiting: rc = 1 00000100:00100000:0.0:1789498547.885878:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff98ea83f68200:5860] 2 exiting: rc = 0 00000100:00100000:3.0:1789498547.887486:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff98ea82fcde00:5859] 1 exiting: rc = 0 00000100:00100000:1.0:1789498547.891527:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891570:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891577:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891585:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891591:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891598:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891660:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891669:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891677:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891683:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891692:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891759:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891770:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891777:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891784:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891790:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891796:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891802:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891810:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891819:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891826:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891833:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891846:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891856:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891864:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891870:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891883:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891890:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891899:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891907:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891931:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891940:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891947:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891954:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891962:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891968:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891983:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891990:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.891997:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892004:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892011:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892019:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892026:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892035:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892044:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892051:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892065:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892078:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892085:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892118:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892126:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892133:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892141:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892149:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892172:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892184:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892190:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892199:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892206:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892226:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892233:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892240:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892247:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498547.892268:0:12924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789498547.901471:0:12924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498547.901493:0:12924:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789498547.901501:0:12924:0:(genops.c:885:class_export_put()) final put ffff98ea910a2800/MDS_uuid 00000020:00000080:1.0:1789498547.901507:0:12924:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea910a2800/MDS_uuid for MDS 00000020:01000000:1.0:1789498547.901516:0:12924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789498547.902381:0:12924:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789498548.154036:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498549.165367:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498549.741607:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885624192:0@lo:400:kworker.0 00000100:00100000:0.0:1789498549.741634:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885624064:0@lo:400:kworker.0 00000400:00000100:0.0:1789498549.741729:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876424885624064 offset 0 length 224: 4 00000400:00000100:1.0:1789498549.741738:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424885624192 offset 0 length 224: 4 00000100:00100000:1.0:1789498549.742019:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885624320:0@lo:400:kworker.0 00000400:00000100:1.0:1789498549.742038:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424885624320 offset 0 length 224: 4 00010000:00010000:3.0:1789498550.187295:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498551.215028:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789498551.949850:0:13076:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789498551.979737:0:13076:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789498551.979814:0:13076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498551.979834:0:13076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498551.979842:0:13076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498551.979870:0:13076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498551.980438:0:13076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789498551.980447:0:13076:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789498551.980498:0:13076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789498551.980516:0:13076:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e98649f480 x1876424885624192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498551.980541:0:13076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789498551.980551:0:13076:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789498551.980590:0:13076:0:(import.c:65:import_set_state_nolock()) ffff98e984c10800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789498551.980685:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885624192:0@lo:400:kworker.0 00000100:00100000:0.0:1789498551.980934:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885624448:0@lo:39:umount.0 00000400:00000100:0.0:1789498551.981006:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424885624448 offset 0 length 224: 4 00010000:00010000:3.0:1789498551.982383:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498551.982402:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498551.982438:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554c00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498551.982443:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498551.982455:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498551.982463:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498551.982470:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789498551.982473:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789498551.982477:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789498551.989701:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498551.989734:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789498551.989819:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885624576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498551.989927:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498551.990048:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885624576 00000100:00100000:3.0:1789498551.990060:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885624576 00000100:00100000:3.0:1789498551.990147:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789498551.990159:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1876424885624576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789498551.990167:0:5832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789498551 with bad export cookie 4209935002705690294 00010000:00010000:0.0:1789498551.995554:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498551.995580:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab6554c00/0x3a6cb1946bc181db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc181e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498551.995610:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498551.995613:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498551.995616:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498552.000362:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1876424885624576:12345-0@lo:103:ldlm_bl.0 Request processed in 10186us (10416us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789498552.000382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789498552.000687:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789498552.000696:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98ea856a3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789498552.000700:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789498552.008591:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789498552.008600:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789498552.008617:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e98649dc00 x1876424885624064/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498552.008763:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eaba23bb80 x1876424885624576/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789498567 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789498552.008774:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789498552.008778:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789498552.008780:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789498552.008786:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98ea856a3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498552.008817:0:3308:0:(import.c:545:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 197 00000100:00080000:2.0:1789498552.008837:0:3308:0:(import.c:666:import_select_connection()) MGC192.168.201.120@tcp: import ffff98ea856a3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498552.008961:0:3308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb4a5880 x1876424885624704/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498552.009034:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec95aa81-4721-4a06-ac30-039c6a8f6732:3304:1876424885624704:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1789498552.009131:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876424885624704 offset 0 length 520: 4 00000100:00100000:3.0:1789498552.009243:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec95aa81-4721-4a06-ac30-039c6a8f6732:3308:1876424885624576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498552.012751:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec95aa81-4721-4a06-ac30-039c6a8f6732:3305:1876424885624064:0@lo:400:kworker.0 00010000:00010000:0.0:1789498552.237826:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498553.259421:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498554.283673:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498554.862510:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498554.862521:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498554.862650:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885624832:0@lo:400:kworker.0 00000400:00000100:0.0:1789498554.862716:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424885624832 offset 0 length 224: 4 00010000:00010000:0.0:1789498555.307306:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498556.331355:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498556.907498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498556.907510:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498556.907744:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885624960:0@lo:400:kworker.0 00000400:00000100:3.0:1789498556.907805:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424885624960 offset 0 length 224: 4 00010000:00010000:0.0:1789498557.355326:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498558.383419:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498559.406630:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498560.429693:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498561.196490:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498551/real 1789498551] req@ffff98eabaa8e680 x1876424885624448/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789498561 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498561.196525:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98eabaa8e680 x1876424885624448/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789498561 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789498561.196547:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e984c10800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789498561.196569:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885624448:0@lo:39:umount.0 00000100:00080000:2.0:1789498561.196874:0:13076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789498561.196879:0:13076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789498561.196884:0:13076:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789498561.198189:0:13076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498561.198207:0:13076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498561.198214:0:13076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498561.198220:0:13076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498561.198248:0:13076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498561.198257:0:13076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498561.198265:0:13076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498561.198289:0:13076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498561.198296:0:13076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498561.198322:0:13076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789498561.198327:0:13076:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789498561.198347:0:13076:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789498561.198351:0:13076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789498561.198357:0:13076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498561.198362:0:13076:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789498561.198366:0:13076:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff98ea83f78000) has no exports 00000020:00080000:2.0:1789498561.198388:0:13076:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff98ea83f78000) has no exports 00010000:00010000:0.0:1789498561.199074:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498561.199085:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498561.199142:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80031e00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498561.199146:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498561.199157:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498561.199165:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498561.199172:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498561.199174:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789498561.199177:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789498561.199195:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea856a3800 00010000:00010000:0.0:1789498561.199200:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498561.199207:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80031e00/0x3a6cb1946bc181e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc181f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498561.199225:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498561.199228:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498561.199252:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea80030200 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498561.199255:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498561.199262:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498561.199268:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498561.199273:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789498561.199275:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789498561.199277:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789498561.199283:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea856a3800 00010000:00010000:0.0:1789498561.199286:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498561.199293:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80030200/0x3a6cb1946bc18412 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc18419 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498561.199302:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498561.199304:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498561.199306:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498561.199906:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789498561.209357:0:13076:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98eaa61edd20 - data ffff98eab82281b0/ffff98eaa1ca5c00 00000020:01000000:2.0:1789498561.209543:0:13076:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea875ab3c0 - data ffff98ea9c82d948/ffff98e984789c00 00100000:10000000:2.0:1789498561.236177:0:13076:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789498561.311007:0:13076:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17fea 00000020:00000080:3.0:1789498561.311023:0:13076:0:(genops.c:885:class_export_put()) final put ffff98ea891bb000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789498561.311051:0:13076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98eabd51c800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789498561.311056:0:13076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eabd51c800 2 00000020:01000004:3.0:1789498561.311059:0:13076:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98eabd51c800 from lustre-OST0000 00000020:00000080:3.0:1789498561.311120:0:13076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498561.311135:0:13076:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789498561.311139:0:13076:0:(genops.c:885:class_export_put()) final put ffff98ea88a63000/lustre-OST0000_UUID 00000020:00000080:3.0:1789498561.311142:0:13076:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea88a63000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789498561.311152:0:13076:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1789498561.312357:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea891bb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1789498561.313672:0:13076:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789498561.313683:0:13076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789498561.313695:0:13076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498561.313707:0:13076:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789498561.313717:0:13076:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98e984c11800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789498561.313726:0:13076:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff98eabb55b380) has exports, disconnecting them 00000020:00080000:3.0:1789498561.313734:0:13076:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98e984c11800), last request at 1789498316 00000020:00000080:3.0:1789498561.313740:0:13076:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18014 00000020:00080000:3.0:1789498561.313762:0:13076:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e984c11800): rc 0 00000020:00000080:3.0:1789498561.313770:0:13076:0:(genops.c:885:class_export_put()) final put ffff98e984c11800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789498561.314322:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e984c11800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789498561.321164:0:13076:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789498561.321178:0:13076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789498561.321183:0:13076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789498561.321229:0:13076:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789498561.321587:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e984c10800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789498561.321810:0:13076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498561.321822:0:13076:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789498561.321830:0:13076:0:(genops.c:885:class_export_put()) final put ffff98e98454f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789498561.321835:0:13076:0:(genops.c:844:class_export_destroy()) destroying export ffff98e98454f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789498561.321843:0:13076:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789498561.321925:0:13076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eabd51c800 1 00000020:00000080:0.0:1789498561.321934:0:13076:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17fa4 00000020:00000080:0.0:1789498561.321942:0:13076:0:(genops.c:885:class_export_put()) final put ffff98ea88193800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789498561.321961:0:13076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789498561.321967:0:13076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498561.321983:0:13076:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789498561.321988:0:13076:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff98ea83f2b380) has no exports 00000020:00000080:1.0:1789498561.322650:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea88193800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789498561.427475:0:13076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498561.427500:0:13076:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789498561.427509:0:13076:0:(genops.c:885:class_export_put()) final put ffff98eabd51d800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789498561.427516:0:13076:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabd51d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789498561.427738:0:13076:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789498561.427932:0:13076:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98eabd519000 00000020:02000400:0.0:1789498561.428007:0:13076:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789498561.606072:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498562.034004:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789498562.034018:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498562.034109:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498562.034128:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885625088:0@lo:400:kworker.0 00000400:00000100:3.0:1789498562.034211:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424885625088 offset 0 length 224: 4 00000100:00100000:2.0:1789498562.221592:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498552/real 1789498552] req@ffff98eabb4a5880 x1876424885624704/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789498562 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498562.221629:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98eabb4a5880 x1876424885624704/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789498562 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789498562.221654:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea856a3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498562.221665:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789498562.221670:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec95aa81-4721-4a06-ac30-039c6a8f6732:3304:1876424885624704:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1789498562.222048:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789498562.222055:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789498562.222058:0:36:0:(import.c:65:import_set_state_nolock()) ffff98ea856a3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498562.222063:0:36:0:(import.c:545:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 451 00000100:00080000:0.0:1789498562.222070:0:36:0:(import.c:630:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789498562.222083:0:36:0:(import.c:666:import_select_connection()) MGC192.168.201.120@tcp: import ffff98ea856a3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1789498562.222304:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eaba238700 x1876424885625216/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498562.223830:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec95aa81-4721-4a06-ac30-039c6a8f6732:3304:1876424885625216:0@lo:250:kworker.0 00000400:00000100:1.0:1789498562.223911:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876424885625216 offset 0 length 520: 4 00010000:00010000:1.0:1789498562.604128:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498563.636506:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498564.652614:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1789498565.102315:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498549/real 1789498549] req@ffff98e98649d500 x1876424885624320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789498565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498565.125633:0:3307:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98e98649d500 x1876424885624320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789498565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789498565.125654:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98ea89107800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789498565.125658:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789498565.137933:0:3307:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1789498565.138082:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885624320:0@lo:400:kworker.0 00000100:00080000:3.0:1789498565.141027:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789498565.141041:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498565.141045:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789498565.141062:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789498565.141067:0:38:0:(import.c:65:import_set_state_nolock()) ffff98ea89107800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498565.141078:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 240 00000100:00080000:3.0:1789498565.141125:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98ea89107800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498565.141179:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb4a6680 x1876424885625344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498565.141357:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885625344:0@lo:38:kworker.0 00000400:00000100:1.0:1789498565.141511:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424885625344 offset 0 length 520: 4 00000020:01000004:1.0:1789498565.464757:0:13227:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789498565.486270:0:13227:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789498565.486383:0:13227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.486413:0:13227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.486432:0:13227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.486440:0:13227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498565.486625:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498565.486635:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498565.486645:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde800 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498565.486650:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498565.486661:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498565.486670:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498565.486677:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789498565.486679:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:3.0:1789498565.486697:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea856a3800 00010000:00010000:3.0:1789498565.486702:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498565.486714:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498565.486716:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498565.486717:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498565.487003:0:13227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498565.487010:0:13227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc181bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc181c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498565.487025:0:13227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:1.0:1789498565.487031:0:13227:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789498565.487066:0:13227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789498565.487225:0:13227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eabaa8f100 x1876424885624832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498565.487244:0:13227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eabaa8ca80 x1876424885624960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498572 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498565.487258:0:13227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eabb4a6d80 x1876424885625088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498578 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498565.487273:0:13227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eabb4a6680 x1876424885625344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498575 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498565.487287:0:13227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789498565.487334:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea89107800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498565.487347:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1789498565.487352:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885625344:0@lo:38:kworker.0 00000100:00100000:3.0:1789498565.487633:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885624832:0@lo:400:kworker.0 00000100:00100000:3.0:1789498565.487665:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885624960:0@lo:400:kworker.0 00000100:00100000:0.0:1789498565.487757:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885625088:0@lo:400:kworker.0 00000100:00080000:1.0:1789498565.488005:0:13227:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789498565.488013:0:13227:0:(import.c:65:import_set_state_nolock()) ffff98ea89107800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789498565.488020:0:13227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789498565.488023:0:13227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789498565.488026:0:13227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789498565.491299:0:13227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.491325:0:13227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.491334:0:13227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.491342:0:13227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.491369:0:13227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498565.491377:0:13227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.491383:0:13227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.491401:0:13227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.491436:0:13227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498565.491459:0:13227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789498565.491465:0:13227:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789498565.491506:0:13227:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789498565.491512:0:13227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789498565.491517:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498565.491523:0:13227:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789498565.491527:0:13227:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff98eabb5599c0) has no exports 00000020:00080000:1.0:1789498565.491558:0:13227:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff98eabb5599c0) has no exports 00010000:00010000:0.0:1789498565.493724:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498565.493747:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.493764:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498565.493770:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.493785:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498565.493793:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498565.493800:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498565.493803:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789498565.493807:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789498565.493835:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea856a3800 00010000:00010000:0.0:1789498565.493840:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.493847:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eab6555e00/0x3a6cb1946bc181cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc181d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.493868:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498565.493874:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.493880:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4a00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498565.493916:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.493925:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498565.493942:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498565.493947:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789498565.493949:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789498565.493951:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789498565.493957:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea856a3800 00010000:00010000:0.0:1789498565.493961:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.493967:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4a00/0x3a6cb1946bc18404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc1840b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.493984:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498565.493986:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498565.493988:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498565.494350:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789498565.496311:0:13227:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98eaa61ed780 - data ffff98eab83385e8/ffff98eabadbb800 00000020:01000000:1.0:1789498565.496731:0:13227:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98eaa61ed180 - data ffff98eab8321870/ffff98e986ab8c00 00100000:10000000:1.0:1789498565.520243:0:13227:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789498565.579285:0:13227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc180b5 00000020:00000080:0.0:1789498565.579299:0:13227:0:(genops.c:885:class_export_put()) final put ffff98e98454f000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789498565.579313:0:13227:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98ea891b9000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789498565.579318:0:13227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98ea891b9000 2 00000020:01000004:0.0:1789498565.579321:0:13227:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98ea891b9000 from lustre-OST0001 00000020:00000080:0.0:1789498565.579371:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498565.579386:0:13227:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789498565.579390:0:13227:0:(genops.c:885:class_export_put()) final put ffff98e984548800/lustre-OST0001_UUID 00000020:00000080:0.0:1789498565.579393:0:13227:0:(genops.c:844:class_export_destroy()) destroying export ffff98e984548800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789498565.579402:0:13227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789498565.579578:0:13227:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ec95aa81-4721-4a06-ac30-039c6a8f6732->MGS 00010000:00010000:0.0:1789498565.579602:0:13227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc17fce expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498565.579617:0:13227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc17fce expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498565.579625:0:13227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789498565.579629:0:13227:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789498565.579634:0:13227:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789498565.579662:0:13227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea856a3800 00010000:00010000:0.0:1789498565.579668:0:13227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac20dba00/0x3a6cb1946bc17fc7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc17fce expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498565.579689:0:13227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc1821a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498565.579697:0:13227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc1821a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498565.579702:0:13227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498565.579705:0:13227:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789498565.579706:0:13227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789498565.579718:0:13227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea856a3800 00010000:00010000:0.0:1789498565.579721:0:13227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea80031200/0x3a6cb1946bc18213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc1821a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789498565.579740:0:13227:0:(import.c:65:import_set_state_nolock()) ffff98ea856a3800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789498565.579745:0:13227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789498565.579748:0:13227:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789498565.579750:0:13227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789498565.579756:0:13227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789498565.579780:0:13227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eaba238700 x1876424885625216/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789498577 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789498565.579807:0:13227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789498565.579811:0:13227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000020:00000080:2.0:1789498565.580152:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98e98454f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1789498565.580261:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec95aa81-4721-4a06-ac30-039c6a8f6732:3304:1876424885625216:0@lo:250:kworker.0 10000000:01000000:2.0:1789498565.580353:0:13227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789498565.580365:0:13227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc17ea8 00000020:00000080:2.0:1789498565.580371:0:13227:0:(genops.c:885:class_export_put()) final put ffff98ea910a6000/ec95aa81-4721-4a06-ac30-039c6a8f6732 00000020:01000000:2.0:1789498565.580389:0:13227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.120@tcp (flags='') 00000020:00000080:2.0:1789498565.580396:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498565.580401:0:13227:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789498565.580406:0:13227:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff98ea83f28000) has no exports 10000000:01000000:2.0:1789498565.580434:0:5842:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789498565.580516:0:13227:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.120@tcp: client import never connected 00000100:00080000:2.0:1789498565.580519:0:13227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789498565.580521:0:13227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789498565.580524:0:13227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789498565.580526:0:13227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789498565.580566:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498565.580572:0:13227:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.120@tcp (uuid ec95aa81-4721-4a06-ac30-039c6a8f6732) 00000020:01000000:2.0:1789498565.580579:0:13227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789498565.580582:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498565.580586:0:13227:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789498565.580592:0:13227:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98eac0b4c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498565.580611:0:13227:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff98e9852699c0) has exports, disconnecting them 00000020:00080000:2.0:1789498565.580617:0:13227:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98eac0b4c800), last request at 1789498340 00000020:00000080:2.0:1789498565.580623:0:13227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc180df 00000020:00080000:2.0:1789498565.580636:0:13227:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98eac0b4c800): rc 0 00000020:00000080:2.0:1789498565.580641:0:13227:0:(genops.c:885:class_export_put()) final put ffff98eac0b4c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789498565.581551:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea910a6000/ec95aa81-4721-4a06-ac30-039c6a8f6732 for MGC192.168.201.120@tcp 00000020:00000080:3.0:1789498565.581576:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea856a3800 for MGC192.168.201.120@tcp 00000020:00000080:3.0:1789498565.581583:0:37:0:(genops.c:885:class_export_put()) final put ffff98ea856a1000/ec95aa81-4721-4a06-ac30-039c6a8f6732 00000020:00000080:3.0:1789498565.581585:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea856a1000/ec95aa81-4721-4a06-ac30-039c6a8f6732 for MGC192.168.201.120@tcp 00000020:01000000:3.0:1789498565.581590:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.120@tcp (ec95aa81-4721-4a06-ac30-039c6a8f6732) 00000020:00000080:3.0:1789498565.581908:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0b4c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789498565.582795:0:13227:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789498565.582804:0:13227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498565.582810:0:13227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789498565.582819:0:13227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789498565.582910:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1789498565.583177:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea89107800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789498565.584178:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1789498565.584401:0:11679:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff98eabb540200:11679] 2 exiting: rc = 0 00000100:00100000:3.0:1789498565.584635:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98ea87e88a00:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1789498565.587208:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98ea8917a600:5828] 0 exiting: rc = 1 00000100:00100000:0.0:1789498565.587430:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.587762:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98ea87e88400:5830] 0 exiting: rc = 1 00000100:00100000:3.0:1789498565.587871:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98ea87e88e00:5831] 1 exiting: rc = 0 00000100:00100000:3.0:1789498565.587956:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98ea87e89400:5832] 2 exiting: rc = 0 00000100:00100000:0.0:1789498565.588296:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588308:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588315:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588323:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588330:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588337:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588344:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588352:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588359:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588366:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588373:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588379:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588385:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588392:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588401:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588409:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588427:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588433:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588438:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588443:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588450:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588455:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588461:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588478:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588483:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588489:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588512:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588518:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588523:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588528:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588534:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588540:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588545:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588550:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588556:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588562:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588569:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588576:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588581:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588587:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588592:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588598:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588604:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588609:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588614:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588619:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588626:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588632:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588639:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588644:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588650:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588656:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588663:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588668:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588673:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588678:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588683:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588689:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588694:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588700:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588706:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588720:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588726:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.588733:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789498565.590236:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498565.590252:0:13227:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789498565.590260:0:13227:0:(genops.c:885:class_export_put()) final put ffff98e98454d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789498565.590266:0:13227:0:(genops.c:844:class_export_destroy()) destroying export ffff98e98454d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789498565.590273:0:13227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789498565.590328:0:13227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98ea891b9000 1 00000020:00000080:3.0:1789498565.590336:0:13227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc18084 00000020:00000080:3.0:1789498565.590355:0:13227:0:(genops.c:885:class_export_put()) final put ffff98eaba051800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789498565.590371:0:13227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789498565.590377:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498565.590394:0:13227:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789498565.590399:0:13227:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff98eabadc19c0) has no exports 00000020:00000080:0.0:1789498565.590730:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba051800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789498565.619261:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498565.619285:0:13227:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789498565.619292:0:13227:0:(genops.c:885:class_export_put()) final put ffff98eababbc800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789498565.619298:0:13227:0:(genops.c:844:class_export_destroy()) destroying export ffff98eababbc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789498565.619308:0:13227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789498565.623224:0:13227:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98e9847f3000 00000020:01000000:0.0:1789498565.623267:0:13227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789498565.623279:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498565.623286:0:13227:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789498565.623292:0:13227:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff98ea83f799c0) has no exports 00000020:00000080:0.0:1789498565.623322:0:13227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498565.623335:0:13227:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789498565.623340:0:13227:0:(genops.c:885:class_export_put()) final put ffff98ea88191000/OSS_uuid 00000020:00000080:0.0:1789498565.623345:0:13227:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea88191000/OSS_uuid for OSS 00000020:01000000:0.0:1789498565.623352:0:13227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789498565.623582:0:5841:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789498565.623787:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff98ea98210400:6702] 1 exiting: rc = 0 00000100:00100000:3.0:1789498565.624153:0:10445:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff98e98595c000:10445] 3 exiting: rc = 0 00000100:00100000:3.0:1789498565.624226:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff98ea884f5600:6701] 0 exiting: rc = 1 00000100:00100000:3.0:1789498565.624284:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff98ea884f1e00:6704] 2 exiting: rc = 0 00000100:00100000:0.0:1789498565.624722:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624739:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624755:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624766:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624799:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624806:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624813:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624819:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624824:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624831:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624836:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624842:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624848:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624868:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624874:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624879:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624885:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624892:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624909:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624915:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624922:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624939:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624946:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624952:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624959:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624966:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624973:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624979:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624985:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624991:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.624998:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625004:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625011:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625019:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625025:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625031:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625040:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625046:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625052:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625058:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625065:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625072:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625077:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625083:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625116:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625123:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625129:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625136:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625151:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625157:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625163:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625170:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625200:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625208:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625215:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625225:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625232:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625239:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625248:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625255:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625261:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625268:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625274:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.625281:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.627169:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98ea884f0a00:6706] 1 exiting: rc = 0 00000100:00100000:3.0:1789498565.627279:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98ea884f1a00:6705] 0 exiting: rc = 1 00000100:00100000:0.0:1789498565.627531:0:8774:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98eaba7ea200:8774] 2 exiting: rc = 0 00000100:00100000:3.0:1789498565.627967:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.627980:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.627987:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.627995:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628000:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628006:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628011:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628017:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628023:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628029:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628034:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628040:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628045:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628050:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628055:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628061:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628066:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628071:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628078:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628085:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628129:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628135:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628141:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628161:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628166:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628173:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628179:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628185:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628191:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628197:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628203:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628208:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628214:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628219:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628225:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628232:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628238:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628243:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628249:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628254:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628260:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628265:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628270:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628276:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628282:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628288:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628296:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628302:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628307:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628313:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628319:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628325:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628330:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628336:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628342:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628348:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628353:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628358:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628372:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628378:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628396:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628403:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628409:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.628416:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.630059:0:6708:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98ea85d20600:6708] 1 exiting: rc = 0 00000100:00100000:0.0:1789498565.630628:0:6709:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98eac1e4cc00:6709] 2 exiting: rc = 0 00000100:00100000:0.0:1789498565.630916:0:6707:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98ea85d21200:6707] 0 exiting: rc = 1 00000100:00100000:3.0:1789498565.631367:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631378:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631538:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631547:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631555:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631562:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631581:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631589:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631595:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631601:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631607:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631614:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631619:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631625:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631631:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631644:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631651:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631657:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631664:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631670:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631677:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631683:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631690:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631696:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631704:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631711:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631717:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631723:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631751:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631758:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631765:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631772:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631779:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631786:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631793:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631800:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631808:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631814:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631821:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631845:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631853:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631859:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631865:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631873:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631880:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631887:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631905:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631913:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.631920:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632202:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632214:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632222:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632231:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632238:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632247:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632256:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632263:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632270:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632278:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632285:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632292:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632308:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632316:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.632333:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641165:0:6711:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98eac1e4d400:6711] 1 exiting: rc = 0 00000100:00100000:0.0:1789498565.641595:0:6710:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98eac1e4ce00:6710] 0 exiting: rc = 1 00000100:00100000:3.0:1789498565.641881:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641891:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641908:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641915:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641921:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641957:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641966:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641973:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641979:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641985:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.641993:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642000:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642007:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642015:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642021:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642028:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642034:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642040:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642046:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642052:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642057:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642064:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642071:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642078:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642084:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642118:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642125:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642132:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642138:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642144:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642149:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642156:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642162:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642185:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642193:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642201:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642209:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642216:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642224:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642230:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642237:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642244:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642250:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642257:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642263:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642270:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642276:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642283:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642288:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642295:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642300:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642306:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642313:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642319:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642324:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642330:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642336:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642341:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642348:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642354:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642360:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642366:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642372:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498565.642397:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.644425:0:6712:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98ea88492e00:6712] 0 exiting: rc = 1 00000100:00100000:3.0:1789498565.644800:0:6713:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98ea88493200:6713] 1 exiting: rc = 0 00000100:00100000:0.0:1789498565.644933:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.644943:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.644950:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.644956:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.644988:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.644996:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645004:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645011:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645017:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645024:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645031:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645037:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645044:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645068:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645075:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645083:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645136:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645146:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645152:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645158:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645165:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645171:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645178:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645186:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645193:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645200:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645206:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645214:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645238:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645246:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645255:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645263:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645270:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645280:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645287:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645295:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645303:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645310:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645317:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645324:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645347:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645355:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645363:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645370:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645378:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645393:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645401:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645409:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645423:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645430:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645437:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645444:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645629:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645639:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645647:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645656:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645664:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645671:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645679:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645687:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645694:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645700:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645707:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498565.645715:0:13227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789498565.660291:0:13227:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789498585.101023:0:13843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789498595.663077:0:14305:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789498595.663083:0:14305:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789498595.663253:0:14305:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98eaba3b0800 00000020:01000004:2.0:1789498595.663270:0:14305:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789498595.663278:0:14305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789498595.663293:0:14305:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98e985268000) 00000020:00000080:2.0:1789498595.663307:0:14305:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789498595.679146:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789498595.681516:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789498595.682032:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 512: rc = 0 00100000:10000000:3.0:1789498595.682168:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 512: rc = 0 00100000:10000000:3.0:1789498595.682275:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 512: rc = 0 00100000:10000000:3.0:1789498595.682386:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 512: rc = 0 00100000:10000000:3.0:1789498595.682578:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789498595.682651:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 512: rc = 0 00100000:10000000:3.0:1789498595.682891:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 512: rc = 0 00100000:10000000:3.0:1789498595.683228:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 514: rc = 0 00100000:10000000:3.0:1789498595.684403:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 389: rc = 0 00100000:10000000:3.0:1789498595.684492:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 389: rc = 0 00100000:10000000:3.0:1789498595.685147:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789498595.685441:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 397: rc = 0 00100000:10000000:3.0:1789498595.685848:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 397: rc = 0 00100000:10000000:3.0:1789498595.686142:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789498595.686401:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 397: rc = 0 00100000:10000000:3.0:1789498595.686648:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789498595.687053:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789498595.687349:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 397: rc = 0 00100000:10000000:3.0:1789498595.687607:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789498595.688009:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 397: rc = 0 00100000:10000000:3.0:1789498595.688322:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 397: rc = 0 00100000:10000000:3.0:1789498595.688586:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789498595.689158:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 660: rc = 0 00100000:10000000:3.0:1789498595.689435:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 660: rc = 0 00100000:10000000:3.0:1789498595.689831:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 660: rc = 0 00100000:10000000:3.0:1789498595.690126:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 660: rc = 0 00100000:10000000:3.0:1789498595.690389:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 660: rc = 0 00100000:10000000:3.0:1789498595.690650:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 660: rc = 0 00100000:10000000:3.0:1789498595.691024:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 660: rc = 0 00100000:10000000:3.0:1789498595.691286:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 660: rc = 0 00100000:10000000:3.0:1789498595.691544:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 660: rc = 0 00100000:10000000:3.0:1789498595.691915:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 660: rc = 0 00100000:10000000:3.0:1789498595.692194:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 660: rc = 0 00100000:10000000:3.0:1789498595.692449:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 660: rc = 0 00100000:10000000:3.0:1789498595.692858:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 660: rc = 0 00100000:10000000:3.0:1789498595.693137:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 660: rc = 0 00100000:10000000:3.0:1789498595.693406:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 660: rc = 0 00100000:10000000:3.0:1789498595.693654:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 660: rc = 0 00100000:10000000:3.0:1789498595.694073:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 660: rc = 0 00100000:10000000:3.0:1789498595.694399:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 660: rc = 0 00100000:10000000:3.0:1789498595.694645:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 660: rc = 0 00100000:10000000:3.0:1789498595.701992:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 660: rc = 0 00100000:10000000:3.0:1789498595.702473:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 660: rc = 0 00100000:10000000:3.0:1789498595.703058:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 660: rc = 0 00100000:10000000:3.0:1789498595.703334:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 660: rc = 0 00100000:10000000:3.0:1789498595.703590:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 660: rc = 0 00100000:10000000:3.0:1789498595.703870:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 660: rc = 0 00100000:10000000:3.0:1789498595.704196:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 660: rc = 0 00100000:10000000:3.0:1789498595.704465:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 660: rc = 0 00100000:10000000:3.0:1789498595.704707:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 660: rc = 0 00100000:10000000:3.0:1789498595.704950:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 660: rc = 0 00100000:10000000:3.0:1789498595.705236:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 660: rc = 0 00100000:10000000:0.0:1789498595.709877:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 660: rc = 0 00100000:10000000:0.0:1789498595.710256:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 660: rc = 0 00100000:10000000:0.0:1789498595.710684:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 773: rc = 0 00100000:10000000:0.0:1789498595.711267:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1789498595.711452:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 393: rc = 0 00100000:10000000:0.0:1789498595.711657:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1789498595.711725:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 393: rc = 0 00100000:10000000:0.0:1789498595.711919:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1789498595.711995:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 393: rc = 0 00100000:10000000:2.0:1789498595.713239:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789498595.713334:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 390: rc = 0 00100000:10000000:2.0:1789498595.714537:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789498595.714654:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 390: rc = 0 00100000:10000000:2.0:1789498595.714976:0:14305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789498595.715042:0:14305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 390: rc = 0 00000020:00000080:2.0:1789498595.715424:0:14305:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789498595.715432:0:14305:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789498595.715441:0:14305:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc1919b 00000020:01000004:2.0:1789498595.715449:0:14305:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789498595.715454:0:14305:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789498595.715460:0:14305:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98eaba3b0800 from MGS 00000020:01000004:2.0:1789498595.715464:0:14305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789498595.715475:0:14305:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98e98526cd40) 00000020:00000080:2.0:1789498595.715496:0:14305:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789498595.715554:0:14305:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98eaba3b0800 from MGS, refs=2 00080000:01000000:2.0:1789498595.715559:0:14305:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789498595.715571:0:14305:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc191a9 00000100:00100000:2.0:1789498595.715667:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789498595.715947:0:14305:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789498595.715953:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789498595.716789:0:14305:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789498595.716798:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789498595.717470:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498595.717664:0:14305:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789498595.717669:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789498595.718903:0:14305:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789498595.718915:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789498595.719327:0:14305:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789498595.719334:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789498595.719873:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498595.719877:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498595.719879:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498595.720249:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498595.720251:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498595.720253:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498595.729426:0:14305:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789498595.733217:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789498595.754832:0:14305:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789498595.754854:0:14305:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789498595.754857:0:14305:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789498595.761660:0:14314:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789498595.761888:0:14305:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789498595.761998:0:14305:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789498595.762794:0:14305:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789498595.763629:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498595.763814:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789498595.763820:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789498595.765830:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789498595.765843:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789498595.779406:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789498595.779419:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789498595.780983:0:14305:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789498595.781009:0:14305:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.120@tcp' 00000020:01000004:0.0:1789498595.781019:0:14305:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789498595.781054:0:14305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.120@tcp (typ=mgc) 00000020:00000080:0.0:1789498595.781069:0:14305:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.120@tcp (ffff98e98443cd40) 00000020:00000080:0.0:1789498595.781120:0:14305:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789498595.781205:0:14305:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98ea88849000@MGC192.168.201.120@tcp: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1789498595.781392:0:14305:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.120@tcp-0 is initialized 00000040:01000000:0.0:1789498595.781398:0:14305:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789498595.781665:0:14319:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789498595.784656:0:14320:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789498595.785113:0:14305:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.120@tcp (uuid 1cf59db6-3bc5-4ded-8751-c46e361eaced) 00000020:00000080:2.0:1789498595.785141:0:14305:0:(genops.c:1384:class_connect()) connect: client 1cf59db6-3bc5-4ded-8751-c46e361eaced, cookie 0x3a6cb1946bc191b7 00000100:00080000:2.0:1789498595.785158:0:14305:0:(import.c:545:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498595.785175:0:14305:0:(import.c:666:import_select_connection()) MGC192.168.201.120@tcp: import ffff98ea88849000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498595.785222:0:14305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabaa8f480 x1876424885625472/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498595.785249:0:14305:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1cf59db6-3bc5-4ded-8751-c46e361eaced->MGS 00000020:01000004:2.0:1789498595.785277:0:14305:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789498595.785290:0:14305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789498595.785309:0:14305:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98e98526b380) 00000020:00000080:2.0:1789498595.785324:0:14305:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789498595.791756:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1cf59db6-3bc5-4ded-8751-c46e361eaced:3304:1876424885625472:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789498595.791862:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498595.794005:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885625472 00000100:00100000:0.0:1789498595.794024:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885625472 00000100:00100000:0.0:1789498595.794084:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498595.794112:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1876424885625472:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789498595.794143:0:14315:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 1cf59db6-3bc5-4ded-8751-c46e361eaced@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1789498595.794177:0:14315:0:(genops.c:1384:class_connect()) connect: client 1cf59db6-3bc5-4ded-8751-c46e361eaced, cookie 0x3a6cb1946bc191c5 00000100:00080000:0.0:1789498595.794331:0:14315:0:(import.c:65:import_set_state_nolock()) ffff98ea88848800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498595.794439:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+5:3304:x1876424885625472:12345-0@lo:250:mount.lustre.0 Request processed in 326us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498595.794448:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498595.802032:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789498595.802051:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:3.0:1789498595.802062:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789498595.802068:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789498595.802073:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea88849000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789498595.802077:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789498595.802112:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789498595.802121:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1cf59db6-3bc5-4ded-8751-c46e361eaced:3304:1876424885625472:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789498595.817931:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498595.818204:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789498595.818212:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789498595.820622:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789498595.820639:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789498595.821767:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789498595.821782:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789498595.823560:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498595.823794:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789498595.823801:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789498595.825045:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789498595.825056:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789498595.865961:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498595.866217:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789498595.866225:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789498595.867645:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789498595.867658:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789498595.868209:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498595.868415:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789498595.868421:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789498595.868943:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789498595.868950:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789498595.869463:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498595.869626:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789498595.869637:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789498595.870433:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789498595.870442:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789498595.871071:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498595.872816:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789498595.872825:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789498595.873511:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789498595.873524:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789498595.924970:0:14305:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498595.925246:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789498595.925253:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789498595.929024:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789498595.929040:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789498595.931403:0:14305:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789498595.931427:0:14305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789498595.939070:0:14305:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789498595.939136:0:14305:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789498595.939143:0:14305:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789498595.939314:0:14305:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789498595.939364:0:14305:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789498595.939373:0:14305:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789498595.939375:0:14305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789498595.939376:0:14305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498595.939377:0:14305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498595.939378:0:14305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498595.939380:0:14305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498595.939381:0:14305:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789498595.939382:0:14305:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789498595.939385:0:14305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498595.939386:0:14305:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789498595.939389:0:14305:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789498595.939391:0:14305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789498595.939392:0:14305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789498595.939393:0:14305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498595.939394:0:14305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498595.939394:0:14305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498595.939395:0:14305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498595.939396:0:14305:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789498595.939397:0:14305:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789498595.939398:0:14305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498595.939399:0:14305:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789498595.939424:0:14305:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789498595.939443:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885625600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789498595.939612:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498595.939667:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498595.940622:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885625600 00000100:00100000:1.0:1789498595.940633:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885625600 00000100:00100000:1.0:1789498595.940696:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498595.940707:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+5:14305:x1876424885625600:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789498595.940762:0:14318:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789498595.940766:0:14318:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789498595.940769:0:14318:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789498595.941270:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789498595.941951:0:14318:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789498595.945010:0:14340:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789498595.945020:0:14340:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789498595.945023:0:14340:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789498595.945058:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789498595.945461:0:14318:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789498595.945473:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789498595.967373:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+5:14305:x1876424885625600:12345-0@lo:253:mount.lustre.0 Request processed in 26645us (27738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498595.967389:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498595.967509:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885625600:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498595.967526:0:14305:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789498595.967529:0:14305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498595.967530:0:14305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789498595.967532:0:14305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498595.967533:0:14305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498595.967534:0:14305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498595.967535:0:14305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498595.967537:0:14305:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789498595.967538:0:14305:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789498595.967541:0:14305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498595.967542:0:14305:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789498595.967578:0:14305:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98eaba3b0800 from lustre-MDT0000 10000000:01000000:3.0:1789498595.967607:0:14305:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789498595.967610:0:14305:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789498595.967615:0:14305:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98e98443cd40 10000000:01000000:3.0:1789498595.967620:0:14305:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498595.967628:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e98443cd40 from 1 10000000:01000000:3.0:1789498595.967631:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789498595.967673:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.967686:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.967696:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498595.967716:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885625728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498595.967751:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498595.967787:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498595.968014:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885625728 00000100:00100000:1.0:1789498595.968021:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885625728 00000100:00100000:1.0:1789498595.968064:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498595.968074:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+5:14305:x1876424885625728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498595.968119:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498595.968136:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc191d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc191cc expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498595.968162:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc191d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc191cc expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498595.968173:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc191d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc191cc expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498595.968193:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde600, rc 0) 00000100:00100000:1.0:1789498595.968233:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+6:14305:x1876424885625728:12345-0@lo:101:mount.lustre.0 Request processed in 160us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498595.968239:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498595.968417:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885625728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498595.968431:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.968440:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498595.968490:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885625856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498595.968528:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498595.968554:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef600 going to sleep for 11 seconds 00000100:00100000:0.0:1789498595.968618:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885625856 00000100:00100000:0.0:1789498595.968623:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885625856 00000100:00100000:0.0:1789498595.968653:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498595.968660:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+6:14305:x1876424885625856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498595.968887:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+6:14305:x1876424885625856:12345-0@lo:501:mount.lustre.0 Request processed in 227us (358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789498595.968902:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498595.969130:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885625856:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789498595.969161:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789498595.969180:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.969190:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498595.969199:0:14305:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98eaba3b0800 10000000:01000000:3.0:1789498595.969203:0:14305:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789498595.969207:0:14305:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98eaba3b0800 10000000:01000000:3.0:1789498595.969210:0:14305:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789498595.969213:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98eaba3b0800 from 1 10000000:01000000:3.0:1789498595.969216:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789498595.969235:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.969243:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.969251:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498595.969265:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885625984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498595.969292:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498595.969307:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498595.969395:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885625984 00000100:00100000:2.0:1789498595.969400:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885625984 00000100:00100000:2.0:1789498595.969423:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498595.969430:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+6:14305:x1876424885625984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498595.969439:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498595.969451:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea91098400/0x3a6cb1946bc191e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc191da expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498595.969469:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91098400/0x3a6cb1946bc191e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc191da expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498595.969479:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea91098400/0x3a6cb1946bc191e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc191da expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498595.969486:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098400, rc 0) 00000100:00100000:2.0:1789498595.969532:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+7:14305:x1876424885625984:12345-0@lo:101:mount.lustre.0 Request processed in 103us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498595.969538:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498595.969701:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885625984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498595.969712:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.969731:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498595.969742:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789498595.969746:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.969753:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498595.969759:0:14305:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789498595.969762:0:14305:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498595.969766:0:14305:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98eaba3b0800 10000000:01000000:3.0:1789498595.969769:0:14305:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789498595.969771:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789498595.969773:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789498595.969786:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.969793:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.969800:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498595.969812:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885626112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498595.969833:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498595.969866:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498595.969984:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885626112 00000100:00100000:2.0:1789498595.969993:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885626112 00000100:00100000:2.0:1789498595.970022:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498595.970028:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+7:14305:x1876424885626112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498595.970036:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498595.970043:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea91099200/0x3a6cb1946bc191ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc191e8 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498595.970055:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91099200/0x3a6cb1946bc191ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc191e8 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498595.970063:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea91099200/0x3a6cb1946bc191ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc191e8 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498595.970069:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099200, rc 0) 00000100:00100000:2.0:1789498595.970123:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+8:14305:x1876424885626112:12345-0@lo:101:mount.lustre.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498595.970130:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498595.970296:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885626112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498595.970306:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498595.970315:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498595.970365:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885626240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498595.970390:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498595.970404:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498595.970455:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885626240 00000100:00100000:2.0:1789498595.970459:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885626240 00000100:00100000:2.0:1789498595.970488:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498595.970504:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+8:14305:x1876424885626240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498595.970835:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+9:14305:x1876424885626240:12345-0@lo:501:mount.lustre.0 Request processed in 341us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498595.971018:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885626240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498595.971047:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885626368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498595.971085:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498595.971134:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef600 going to sleep for 11 seconds 00000100:00100000:0.0:1789498595.971200:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885626368 00000100:00100000:0.0:1789498595.971206:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885626368 00000100:00100000:0.0:1789498595.971225:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498595.971232:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+10:14305:x1876424885626368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498595.971565:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+10:14305:x1876424885626368:12345-0@lo:503:mount.lustre.0 Request processed in 332us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498595.971573:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498595.971761:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498595.971940:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885626368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498595.973706:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14341:1876424885626496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498595.973794:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498595.973829:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea884e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498595.973968:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885626496 00000100:00100000:0.0:1789498595.973976:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885626496 00000100:00100000:0.0:1789498595.974026:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498595.974036:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+9:14341:x1876424885626496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498595.974600:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+9:14341:x1876424885626496:12345-0@lo:502:llog_process_th.0 Request processed in 564us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498595.974608:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498595.974958:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14341:1876424885626496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498595.974990:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498595.975002:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498595.975005:0:14341:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789498595.975010:0:14341:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789498595.975014:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498595.975028:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98eabadc0000) 00000020:00000080:1.0:1789498595.975047:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789498595.975053:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789498595.975183:0:14341:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789498595.975191:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc191fd 00000020:00000080:1.0:1789498595.975459:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789498595.975464:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498595.975468:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498595.975469:0:14341:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789498595.975473:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498595.975476:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498595.975478:0:14341:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789498595.975481:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498595.975489:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98eabadc4d40) 00000020:00000080:1.0:1789498595.975511:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789498595.975522:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789498595.975525:0:14341:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789498595.975527:0:14341:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789498595.975534:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789498595.975575:0:14341:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98eaba3b0800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789498595.975588:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98eabadc3380) 00000020:00000080:1.0:1789498595.975596:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789498595.975658:0:14341:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789498595.975665:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc19212 00000020:00000080:1.0:1789498595.975761:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789498595.975767:0:14341:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789498595.975772:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3a6cb1946bc19219 00080000:01000000:1.0:1789498595.975777:0:14341:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789498595.975786:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19220 00010000:00010000:2.0:1789498596.067019:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789498596.067550:0:14341:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789498596.067749:0:14341:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789498596.068586:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98e9852699c0) 00000020:00000080:2.0:1789498596.068614:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789498596.068700:0:14341:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789498596.068707:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc1922e 00000020:00000080:3.0:1789498596.069236:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789498596.073500:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3a6cb1946bc19235 00000020:00000080:1.0:1789498596.073870:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789498596.073881:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.073886:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.073888:0:14341:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789498596.073890:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789498596.073892:0:14341:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789498596.073893:0:14341:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789498596.073894:0:14341:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789498596.073895:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789498596.073896:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.073897:0:14341:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789498596.073899:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498596.073902:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.073903:0:14341:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789498596.073906:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789498596.073935:0:14341:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789498596.073946:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.073947:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.073948:0:14341:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789498596.073949:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789498596.073956:0:14341:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789498596.073958:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.073959:0:14341:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789498596.073961:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789498596.073965:0:14341:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1789498596.073988:0:14341:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789498596.073991:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498596.074005:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98eabadc19c0) 00000020:00000080:1.0:1789498596.074019:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789498596.074024:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789498596.074109:0:14341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789498596.074116:0:14341:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789498596.074123:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19243 00010000:00080000:1.0:1789498596.074154:0:14341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98eaba5d5000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1789498596.074310:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789498596.074642:0:14341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789498596.074689:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789498596.075473:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498596.075534:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789498596.075615:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789498596.076321:0:14344:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498596.076327:0:14344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789498596.081744:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789498596.081763:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789498596.081810:0:14341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789498596.081830:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc1924a 00000100:00080000:1.0:1789498596.081853:0:14341:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789498596.081865:0:14341:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98eaba5d5000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1789498596.081904:0:14341:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e98649f480 x1876424885626624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498596.081932:0:14341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789498596.081996:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.082005:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.082007:0:14341:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789498596.082010:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789498596.082013:0:14341:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789498596.082014:0:14341:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789498596.082016:0:14341:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789498596.082017:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789498596.082019:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.082021:0:14341:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789498596.082023:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789498596.082027:0:14341:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789498596.082030:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.082032:0:14341:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789498596.082034:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789498596.082037:0:14341:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1789498596.082058:0:14341:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789498596.082060:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498596.082074:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98eabb5599c0) 00000020:00000080:1.0:1789498596.082085:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789498596.082114:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789498596.082170:0:14341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789498596.082177:0:14341:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789498596.082184:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19258 00010000:00080000:1.0:1789498596.082212:0:14341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98ea82998800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1789498596.082439:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789498596.082674:0:14341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789498596.082700:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789498596.083223:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498596.083298:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789498596.083391:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1789498596.083661:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885626624:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789498596.083744:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424885626624 offset 0 length 520: 4 00000040:00080000:0.0:1789498596.084560:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498596.084566:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789498596.085341:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789498596.085365:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789498596.085410:0:14341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789498596.085431:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc1925f 00000100:00080000:1.0:1789498596.085443:0:14341:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789498596.085457:0:14341:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea82998800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1789498596.085496:0:14341:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e98649f800 x1876424885626752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498596.085553:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885626752:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789498596.085600:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424885626752 offset 0 length 520: 4 00000100:00080000:1.0:1789498596.085653:0:14341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789498596.085739:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.085743:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.085746:0:14341:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789498596.085749:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498596.085753:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.085755:0:14341:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789498596.085758:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789498596.085760:0:14341:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789498596.085762:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.085765:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.085766:0:14341:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789498596.085768:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498596.085770:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.085772:0:14341:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789498596.085776:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789498596.085808:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14341:1876424885626880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498596.085870:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.085906:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885626880 00000100:00100000:1.0:1789498596.085913:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885626880 00000100:00100000:1.0:1789498596.085954:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789498596.085964:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+9:14341:x1876424885626880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498596.086223:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+9:14341:x1876424885626880:12345-0@lo:502:llog_process_th.0 Request processed in 259us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498596.086239:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789498596.086275:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84f7fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498596.086294:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14341:1876424885626880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498596.086319:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.086322:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.086324:0:14341:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789498596.086327:0:14341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789498596.086390:0:14305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789498596.086411:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789498596.086428:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498596.086439:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498596.086448:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98eaba3b0800 from 1 10000000:01000000:1.0:1789498596.086450:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789498596.086477:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498596.086486:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498596.086495:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498596.086510:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498596.086536:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.086555:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498596.086786:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885627008 00000100:00100000:2.0:1789498596.086791:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885627008 00000100:00100000:2.0:1789498596.086828:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789498596.086846:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+9:14305:x1876424885627008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498596.086858:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498596.086873:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19266 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.086897:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.086910:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.086919:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099e00, rc 0) 00000100:00100000:2.0:1789498596.086952:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+10:14305:x1876424885627008:12345-0@lo:101:mount.lustre.0 Request processed in 118us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498596.086960:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789498596.087083:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498596.087121:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498596.087131:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498596.087616:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627136:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789498596.087659:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.087683:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498596.087703:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885627136 00000100:00100000:1.0:1789498596.087707:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885627136 00000100:00100000:1.0:1789498596.087730:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498596.087736:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+10:14305:x1876424885627136:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789498596.087753:0:14316:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789498596.087759:0:14316:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789498596.087826:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+10:14305:x1876424885627136:12345-0@lo:256:mount.lustre.0 Request processed in 90us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498596.087832:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498596.090117:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627136:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789498596.090692:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789498596.090718:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498596.090731:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498596.090757:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eaba3b0800 from 1 10000000:01000000:1.0:1789498596.090760:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789498596.090794:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498596.090802:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498596.090812:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498596.090833:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498596.091619:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.091670:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef780 going to sleep for 11 seconds 00000100:00100000:3.0:1789498596.091726:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885627264 00000100:00100000:3.0:1789498596.091737:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885627264 00000100:00100000:3.0:1789498596.091804:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498596.091814:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+10:14305:x1876424885627264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498596.091829:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498596.091922:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19274 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.091951:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.091963:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.091971:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91800, rc 0) 00000100:00100000:3.0:1789498596.092016:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14305:x1876424885627264:12345-0@lo:101:mount.lustre.0 Request processed in 205us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498596.092023:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789498596.092130:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498596.092147:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498596.092158:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498596.092223:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498596.092249:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.092269:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef780 going to sleep for 11 seconds 00000100:00100000:3.0:1789498596.092660:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885627392 00000100:00100000:3.0:1789498596.092666:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885627392 00000100:00100000:3.0:1789498596.092696:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498596.092704:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14305:x1876424885627392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498596.093556:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14305:x1876424885627392:12345-0@lo:501:mount.lustre.0 Request processed in 849us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498596.093568:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498596.093708:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498596.093768:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498596.093824:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.093950:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef780 going to sleep for 11 seconds 00000100:00100000:0.0:1789498596.093990:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885627520 00000100:00100000:0.0:1789498596.093996:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885627520 00000100:00100000:0.0:1789498596.094067:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789498596.094076:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14305:x1876424885627520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498596.094270:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14305:x1876424885627520:12345-0@lo:503:mount.lustre.0 Request processed in 195us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498596.094277:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789498596.094360:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498596.094763:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14349:1876424885627648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498596.094800:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.095011:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef480 going to sleep for 11 seconds 00000100:00100000:3.0:1789498596.095218:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885627648 00000100:00100000:3.0:1789498596.095224:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885627648 00000100:00100000:3.0:1789498596.095251:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789498596.095259:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14349:x1876424885627648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498596.095548:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14349:x1876424885627648:12345-0@lo:502:llog_process_th.0 Request processed in 288us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498596.095562:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498596.095701:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14349:1876424885627648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498596.095729:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498596.095742:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.095745:0:14349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789498596.095752:0:14349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98eaba3b0800 00000020:00000080:1.0:1789498596.095755:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498596.095765:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.095767:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.095769:0:14349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789498596.095772:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498596.095774:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.095775:0:14349:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789498596.095779:0:14349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98eaba3b0800 00000020:00000080:1.0:1789498596.095781:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498596.095856:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.095860:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.095861:0:14349:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789498596.095863:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498596.095866:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.095867:0:14349:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789498596.095870:0:14349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98eaba3b0800 00000020:00000080:1.0:1789498596.095872:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789498596.095915:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14349:1876424885627776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498596.095959:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.095988:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef480 going to sleep for 11 seconds 00000100:00100000:3.0:1789498596.096082:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885627776 00000100:00100000:3.0:1789498596.096113:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885627776 00000100:00100000:3.0:1789498596.096144:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498596.096151:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14349:x1876424885627776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498596.096285:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14349:x1876424885627776:12345-0@lo:502:llog_process_th.0 Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498596.096291:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789498596.098177:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14349:1876424885627776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498596.098217:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498596.098226:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498596.098228:0:14349:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789498596.098232:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789498596.098406:0:14305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789498596.098430:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498596.098456:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.098470:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498596.098522:0:14305:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789498596.098525:0:14305:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98eaba3b0800 10000000:01000000:3.0:1789498596.098529:0:14305:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98eaba3b0800 10000000:01000000:3.0:1789498596.098532:0:14305:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498596.098539:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98eaba3b0800 from 1 10000000:01000000:3.0:1789498596.098541:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789498596.098576:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.098585:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.098596:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498596.098625:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498596.098684:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498596.098723:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84b16540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498596.098743:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885627904 00000100:00100000:3.0:1789498596.098749:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885627904 00000100:00100000:3.0:1789498596.098785:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498596.098794:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14305:x1876424885627904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498596.098808:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498596.098820:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad91400/0x3a6cb1946bc19289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19282 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.098857:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad91400/0x3a6cb1946bc19289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19282 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.098870:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad91400/0x3a6cb1946bc19289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19282 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.098879:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91400, rc 0) 00000100:00100000:3.0:1789498596.098919:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14305:x1876424885627904:12345-0@lo:101:mount.lustre.0 Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498596.098925:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498596.098965:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885627904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498596.098979:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498596.098988:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498596.099041:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885628032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498596.099066:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498596.099080:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84b16540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498596.099120:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885628032 00000100:00100000:3.0:1789498596.099124:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885628032 00000100:00100000:3.0:1789498596.099146:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498596.099153:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14305:x1876424885628032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498596.099420:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14305:x1876424885628032:12345-0@lo:501:mount.lustre.0 Request processed in 266us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498596.099427:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498596.099459:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885628032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498596.099486:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885628160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498596.099520:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498596.099532:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84b16540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498596.099544:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885628160 00000100:00100000:3.0:1789498596.099547:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885628160 00000100:00100000:3.0:1789498596.099567:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498596.099572:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14305:x1876424885628160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498596.099733:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14305:x1876424885628160:12345-0@lo:503:mount.lustre.0 Request processed in 159us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498596.099740:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498596.099777:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885628160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498596.102416:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14351:1876424885628288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498596.102505:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498596.102549:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84b16d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789498596.102608:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885628288 00000100:00100000:2.0:1789498596.102615:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885628288 00000100:00100000:2.0:1789498596.102669:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498596.102680:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14351:x1876424885628288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498596.102948:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14351:x1876424885628288:12345-0@lo:502:llog_process_th.0 Request processed in 270us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498596.102955:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789498596.103141:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14351:1876424885628288:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789498596.103203:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789498596.103216:0:14351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98ea83f28000) 00000020:00000080:3.0:1789498596.103236:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789498596.103311:0:14351:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98eaba3b0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789498596.103316:0:14351:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98eaba3b0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789498596.103319:0:14351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eaba3b0800 4 00010000:00080000:3.0:1789498596.103348:0:14351:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98ea85c62000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1789498596.109268:0:14351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789498596.109493:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789498596.109538:0:14351:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789498596.109553:0:14351:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3a6cb1946bc19297 00000100:00080000:3.0:1789498596.109566:0:14351:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498596.109580:0:14351:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98ea85c62000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498596.109624:0:14351:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb4a6300 x1876424885628416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498596.109675:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885628416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498596.109750:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789498596.109820:0:14351:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789498596.111020:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885628416 00000100:00100000:1.0:1789498596.111037:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885628416 00000100:00100000:1.0:1789498596.111107:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498596.111116:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885628416:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789498596.111199:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885628416:12345-0@lo:38:llog_process_th.0 Request processed in 83us (1448us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789498596.111206:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498596.111259:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789498596.111269:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea85c62000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498596.111273:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789498596.111277:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885628416:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789498596.119677:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14351:1876424885628544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498596.119760:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498596.119803:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885628544 00000100:00100000:1.0:1789498596.119810:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885628544 00000100:00100000:1.0:1789498596.119867:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498596.119875:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14351:x1876424885628544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498596.120210:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14351:x1876424885628544:12345-0@lo:502:llog_process_th.0 Request processed in 335us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498596.120226:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498596.120268:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eababef780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498596.120287:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1cf59db6-3bc5-4ded-8751-c46e361eaced:14351:1876424885628544:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789498596.120310:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789498596.123009:0:14305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789498596.123053:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789498596.124965:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.124987:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789498596.125061:0:14305:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789498596.125064:0:14305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498596.125065:0:14305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498596.125066:0:14305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498596.125067:0:14305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498596.125069:0:14305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498596.125071:0:14305:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498596.125072:0:14305:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498596.125075:0:14305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498596.125076:0:14305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789498596.125081:0:14305:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789498596.125083:0:14305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789498596.125085:0:14305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498596.125086:0:14305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498596.125101:0:14305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498596.125102:0:14305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498596.125103:0:14305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498596.125105:0:14305:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498596.125105:0:14305:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498596.125107:0:14305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498596.125108:0:14305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789498596.125140:0:14305:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789498596.125164:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885628672:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789498596.125247:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498596.125308:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526240 going to sleep for 11 seconds 00000100:00100000:3.0:1789498596.126975:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885628672 00000100:00100000:3.0:1789498596.126991:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885628672 00000100:00100000:3.0:1789498596.127062:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789498596.127073:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14305:x1876424885628672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789498596.127142:0:14318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789498596.127166:0:14318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789498596.172971:0:14318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789498596.172993:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789498596.173115:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789498596.173133:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789498596.173154:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.173173:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.173183:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.173222:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.173233:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 12 pid: 14315 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498596.173244:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1876424885628800:0@lo:104: 00000100:00100000:2.0:1789498596.173309:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498596.173358:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88780 going to sleep for 11 seconds 00000100:00100000:0.0:1789498596.173373:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885628800 00000100:00100000:0.0:1789498596.173382:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885628800 00000100:00100000:0.0:1789498596.173436:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498596.173446:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:14339:x1876424885628800:12345-0@lo:104: 00010000:00010000:0.0:1789498596.173470:0:14306:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.173538:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789498596.173545:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:14339:x1876424885628800:12345-0@lo:104: Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498596.173552:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789498596.173580:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498596.173587:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.173594:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf800 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498596.173599:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.173608:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498596.173615:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498596.173621:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789498596.173641:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1876424885628800:0@lo:104: 00010000:00010000:0.0:1789498596.173652:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.173659:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.173659:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498596.173819:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.173827:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1926d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.173850:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498596.173852:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498596.173854:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498596.173859:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885628928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498596.173891:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498596.173927:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885628928 00000100:00100000:0.0:1789498596.173932:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885628928 00010000:00010000:0.0:1789498596.173949:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 13 pid: 14315 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498596.174021:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498596.174028:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf59db6-3bc5-4ded-8751-c46e361eaced+13:3308:x1876424885628928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498596.174039:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498596.174044:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 13 pid: 14315 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174054:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 13 pid: 14315 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174066:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc1926d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19266 expref: 13 pid: 14315 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174078:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174085:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789498596.174119:0:14308:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000986750s 00010000:00010000:0.0:1789498596.174122:0:14308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174139:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174145:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174151:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174156:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498596.174160:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174167:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174190:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498596.174199:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498596.174230:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:3308:x1876424885628928:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498596.174237:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789498596.174284:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.174293:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498596.174300:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc1929e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498596.174317:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885628928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498596.179397:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14305:x1876424885628672:12345-0@lo:253:mount.lustre.0 Request processed in 52317us (54140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498596.179415:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498596.180218:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:14305:1876424885628672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789498596.180235:0:14305:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789498596.180239:0:14305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789498596.180241:0:14305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789498596.180242:0:14305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498596.180244:0:14305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498596.180245:0:14305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498596.180247:0:14305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498596.180248:0:14305:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789498596.180250:0:14305:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789498596.180252:0:14305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498596.180253:0:14305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789498596.180268:0:14305:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789498596.184538:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498596.185140:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789498596.185445:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498596.185605:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789498596.186084:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498596.186334:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789498596.187238:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498596.187412:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789498596.187808:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498596.188061:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789498596.188442:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498596.188601:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789498596.243051:0:14305:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789498596.243821:0:14305:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789498596.244058:0:14362:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789498596.244063:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789498596.244190:0:14363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789498596.244264:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789498596.246363:0:14305:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789498596.246485:0:14305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789498596.248400:0:14305:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789498596.248423:0:14305:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789498596.250064:0:14305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498596.251299:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789498596.251392:0:14363:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789498596.251397:0:14363:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1789498596.252449:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789498596.253304:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789498596.253367:0:14305:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789498596.257382:0:14305:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789498596.276471:0:14305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789498596.381877:0:14305:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789498596.381924:0:14305:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba75c19b3988 00100000:10000000:3.0:1789498596.381934:0:14305:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789498596.383722:0:14305:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498596.383741:0:14305:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498596.383760:0:14305:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789498596.383791:0:14305:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789498596.783468:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789498597.037779:0:14320:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789498597.037787:0:14320:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98eaba3b0800 from 6 10000000:01000000:0.0:1789498597.037792:0:14320:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789498597.037838:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498597.037849:0:14320:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498597.037861:0:14320:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498597.038033:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba238380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885629056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498597.038245:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498597.043829:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885629056 00000100:00100000:2.0:1789498597.043855:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885629056 00000100:00100000:2.0:1789498597.044016:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789498597.044030:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14320:x1876424885629056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498597.044053:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498597.044079:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc192a5 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498597.044124:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498597.044136:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498597.044164:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098200, rc 0) 00000100:00100000:2.0:1789498597.044270:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14320:x1876424885629056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (6009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498597.044364:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789498597.044441:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526240 going to sleep for 11 seconds 00000100:00100000:2.0:1789498597.044474:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba238380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885629056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498597.044495:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498597.044507:0:14320:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498597.044580:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885629184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789498597.044622:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498597.044648:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498597.044670:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885629184 00000100:00100000:2.0:1789498597.044675:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885629184 00000100:00100000:2.0:1789498597.045927:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789498597.045942:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14320:x1876424885629184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789498597.045972:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789498597.046006:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789498597.046010:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789498597.046166:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14320:x1876424885629184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 226us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498597.046177:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498597.047557:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885629184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789498597.047642:0:14320:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789498597.047655:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498597.047668:0:14320:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498597.170746:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789498597.803338:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498598.200171:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789498598.831168:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498599.854312:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498600.875942:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498601.459200:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498601.459207:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498601.459210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498601.459213:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498601.459216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789498601.459219:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789498601.459222:0:36:0:(import.c:65:import_set_state_nolock()) ffff98ea85c62000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498601.459237:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98ea85c62000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1789498601.459284:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eaba239c00 x1876424885629440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498601.459372:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885629312:0@lo:400:kworker.0 00000100:00100000:0.0:1789498601.459436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498601.459507:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885629312 00000100:00100000:0.0:1789498601.459516:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885629312 00000100:00100000:0.0:1789498601.460015:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789498601.460026:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:3305:x1876424885629312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498601.460084:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:3305:x1876424885629312:12345-0@lo:400:kworker.0 Request processed in 61us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498601.460110:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789498601.460334:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885629440:0@lo:38:kworker.0 00000100:00100000:0.0:1789498601.460379:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498601.460418:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885629440 00000100:00100000:0.0:1789498601.460422:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885629440 00000100:00100000:0.0:1789498601.460442:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498601.460447:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876424885629440:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789498601.460470:0:14325:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:0.0:1789498601.460506:0:14325:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3a6cb1946bc192b3 00000004:00100000:0.0:1789498601.460519:0:14325:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1789498601.460727:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885629312:0@lo:400:kworker.0 00000100:00080000:0.0:1789498601.461330:0:14325:0:(import.c:65:import_set_state_nolock()) ffff98e98441e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498601.461401:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876424885629440:12345-0@lo:38:kworker.0 Request processed in 951us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498601.461409:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789498601.462073:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98eaba239c00 x1876424885629440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789498601.462124:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789498601.462133:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789498601.462139:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789498601.462151:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea85c62000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789498601.462158:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885629440:0@lo:38:kworker.0 00000001:02000400:3.0:1789498601.710130:0:14606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789498601.900197:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498602.926159:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498603.948358:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498604.975549:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789498605.359628:0:14756:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc196b3d60 20000000:00000080:1.0:1789498605.359657:0:14756:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98eabb83f400 uarg=0000000000000000 20000000:01000000:1.0:1789498605.359714:0:14756:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789498605.359723:0:14756:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789498605.359730:0:14756:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789498605.368360:0:14757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789498605.368869:0:14756:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789498605.382034:0:14756:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789498605.382207:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498605.382234:0:14756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498605.382244:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498605.382304:0:14756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498605.382328:0:14756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 11 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498605.382351:0:14756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14756:1876424885629568:0@lo:104: 00000100:00100000:2.0:1789498605.382455:0:14756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498605.382530:0:14756:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88300 going to sleep for 11 seconds 00000100:00100000:1.0:1789498605.383780:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885629568 00000100:00100000:1.0:1789498605.383802:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885629568 00000100:00100000:1.0:1789498605.383928:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498605.383942:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:14756:x1876424885629568:12345-0@lo:104: 00010000:00010000:1.0:1789498605.383965:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498605.384132:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789498605.384140:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:14756:x1876424885629568:12345-0@lo:104: Request processed in 202us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498605.384148:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498605.384267:0:14756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14756:1876424885629568:0@lo:104: 00010000:00010000:2.0:1789498605.384305:0:14756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384439:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498605.384451:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384460:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfa00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498605.384465:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384475:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498605.384483:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498605.384490:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789498605.384557:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384588:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498605.384620:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384627:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1927b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384649:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498605.384651:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498605.384653:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498605.384687:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885629696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498605.384744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498605.384833:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885629696 00000100:00100000:3.0:1789498605.384839:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885629696 00010000:00010000:3.0:1789498605.384867:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 12 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498605.384893:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498605.384900:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:3306:x1876424885629696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498605.384914:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498605.384921:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 12 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384933:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 12 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384948:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad91800/0x3a6cb1946bc1927b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19274 expref: 12 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384977:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.384987:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.385005:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.385013:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.385020:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.385040:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.385046:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498605.385051:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.385059:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.385073:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498605.385084:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498605.385162:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:3306:x1876424885629696:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498605.385176:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498605.385233:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885629696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498605.385583:0:14756:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498605.385594:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498605.385600:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91099600/0x3a6cb1946bc192ba lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498605.995351:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498606.571517:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498596/real 1789498596] req@ffff98e98649f800 x1876424885626752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498606.571557:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e98649f800 x1876424885626752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498606.571592:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498596/real 1789498596] req@ffff98e98649f480 x1876424885626624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498606.571606:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e98649f480 x1876424885626624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789498606.571628:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498606.571671:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789498606.571675:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885626752:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789498606.571682:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98eaba5d5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498606.571688:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789498606.571691:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885626624:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789498606.576264:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885629824:0@lo:400:kworker.0 00000100:00100000:1.0:1789498606.576384:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498606.576489:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885629824 00000100:00100000:1.0:1789498606.576500:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885629824 00000100:00100000:1.0:1789498606.576567:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789498606.576578:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:3307:x1876424885629824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498606.576646:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:3307:x1876424885629824:12345-0@lo:400:kworker.0 Request processed in 69us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498606.576669:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789498606.576878:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885629824:0@lo:400:kworker.0 00000100:00080000:3.0:1789498606.580708:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498606.580724:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789498606.580729:0:37:0:(import.c:65:import_set_state_nolock()) ffff98eaba5d5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498606.580848:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:3.0:1789498606.580856:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789498606.580874:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98eaba5d5000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498606.580985:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb4a4380 x1876424885629952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498606.581016:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498606.581020:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498606.581022:0:37:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498606.581026:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:3.0:1789498606.581029:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789498606.581035:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea82998800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498606.581049:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb4a7480 x1876424885630080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498606.581212:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498606.581234:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885630208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498606.581344:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498606.581423:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885630208 00000100:00100000:1.0:1789498606.581434:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885630208 00000100:00100000:1.0:1789498606.581489:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498606.581499:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885630208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498606.581556:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885630208:12345-0@lo:400:kworker.0 Request processed in 57us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498606.581565:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789498606.581608:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98eabb4a6a00 x1876424885630208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498606.581624:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885630208:0@lo:400:kworker.0 00000100:00100000:2.0:1789498606.583819:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885629952:0@lo:8:kworker.0 00000400:00000100:2.0:1789498606.583921:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424885629952 offset 0 length 520: 4 00000100:00100000:2.0:1789498606.583983:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885630080:0@lo:8:kworker.0 00000400:00000100:2.0:1789498606.584013:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424885630080 offset 0 length 520: 4 10000000:01000000:0.0:1789498606.832297:0:14320:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789498606.832310:0:14320:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eaba3b0800 from 10 10000000:01000000:0.0:1789498606.832319:0:14320:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498606.832398:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498606.832413:0:14320:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498606.832426:0:14320:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498606.832465:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885630336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498606.832571:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498606.833240:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526180 going to sleep for 11 seconds 00000100:00100000:1.0:1789498606.833622:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885630336 00000100:00100000:1.0:1789498606.833635:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885630336 00000100:00100000:1.0:1789498606.833707:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498606.833720:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+11:14320:x1876424885630336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498606.833743:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498606.833766:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc192c1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498606.833802:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498606.833815:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498606.833825:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddfc00, rc 0) 00000100:00100000:1.0:1789498606.833914:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14320:x1876424885630336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498606.833935:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498606.834127:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885630336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498606.834150:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498606.834171:0:14320:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498606.834272:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885630464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498606.834313:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498606.834342:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea874a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1789498606.834401:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885630464 00000100:00100000:1.0:1789498606.834406:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885630464 00000100:00100000:1.0:1789498606.834439:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498606.834447:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14320:x1876424885630464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498606.834771:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14320:x1876424885630464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498606.834778:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498606.834843:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885630464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498606.834887:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885630592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498606.834932:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498606.834956:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea874a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1789498606.835056:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885630592 00000100:00100000:1.0:1789498606.835060:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885630592 00000100:00100000:1.0:1789498606.835129:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789498606.835137:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14320:x1876424885630592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498606.835328:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:14320:x1876424885630592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498606.835336:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789498606.835519:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885630592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789498606.837203:0:14813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789498606.837517:0:14320:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789498606.837541:0:14320:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498606.837556:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498606.837571:0:14320:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498607.022335:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498608.046364:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498608.428401:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789498609.067505:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498610.102118:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498611.117389:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498611.691472:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498611.691482:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498611.691484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498611.691487:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498611.691601:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885630720:0@lo:400:kworker.0 00000100:00100000:3.0:1789498611.691705:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498611.691763:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498611.691770:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885630848:0@lo:400:kworker.0 00000100:00100000:3.0:1789498611.691799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498611.691838:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885630720 00000100:00100000:3.0:1789498611.691857:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885630720 00000100:00100000:3.0:1789498611.691917:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789498611.691927:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:3305:x1876424885630720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498611.692002:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:3305:x1876424885630720:12345-0@lo:400:kworker.0 Request processed in 76us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498611.692010:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789498611.692052:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885630848 00000100:00100000:3.0:1789498611.692057:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885630848 00000100:00100000:3.0:1789498611.692120:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498611.692128:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885630848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498611.692162:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885630848:12345-0@lo:400:kworker.0 Request processed in 35us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498611.692168:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789498611.692218:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98eaba238e00 x1876424885630848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498611.692233:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885630848:0@lo:400:kworker.0 00000100:00100000:3.0:1789498611.692244:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885630720:0@lo:400:kworker.0 00000020:01000004:0.0:1789498611.735615:0:15005:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789498611.735619:0:15005:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789498611.735733:0:15005:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e98441a800 00000020:01000004:0.0:1789498611.735750:0:15005:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789498611.735762:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789498611.735775:0:15005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98e98443b380) 00000020:00000080:0.0:1789498611.735793:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789498611.760281:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789498611.760654:0:15005:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789498611.766664:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789498611.766979:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789498611.767383:0:15005:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789498611.767818:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 539: rc = 0 00100000:10000000:1.0:1789498611.767954:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:1.0:1789498611.768047:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 539: rc = 0 00100000:10000000:1.0:1789498611.768799:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 568: rc = 0 00100000:10000000:1.0:1789498611.769056:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 568: rc = 0 00100000:10000000:1.0:1789498611.769431:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 568: rc = 0 00100000:10000000:1.0:1789498611.772820:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 568: rc = 0 00100000:10000000:1.0:1789498611.773323:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 568: rc = 0 00100000:10000000:1.0:1789498611.774434:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 568: rc = 0 00000020:00000080:1.0:1789498611.775812:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789498611.775824:0:15005:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789498611.775835:0:15005:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3a6cb1946bc192d6 00000020:01000004:1.0:1789498611.775842:0:15005:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789498611.775859:0:15005:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789498611.775862:0:15005:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789498611.775866:0:15005:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789498611.775869:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789498611.775879:0:15005:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98eabb55b380) 00000020:00000080:1.0:1789498611.775887:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789498611.777743:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498611.777927:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789498611.777933:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789498611.779063:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789498611.779082:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789498611.779491:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789498611.779497:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789498611.790566:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498611.790747:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789498611.790754:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789498611.794364:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789498611.794385:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789498611.832551:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498611.832800:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789498611.832808:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789498611.837025:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789498611.837043:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789498611.842528:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789498611.842543:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789498611.844974:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498611.845681:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789498611.845691:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789498611.847632:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789498611.847648:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789498611.892966:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498611.893952:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789498611.893962:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789498611.896964:0:15005:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789498611.896982:0:15005:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789498611.897948:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789498611.897974:0:15005:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789498611.897980:0:15005:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789498611.922970:0:15005:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789498611.923010:0:15005:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789498611.923019:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789498611.923020:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789498611.923022:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498611.923022:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498611.923023:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498611.923025:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498611.923026:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498611.923027:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498611.923029:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789498611.923032:0:15005:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789498611.923034:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789498611.923035:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789498611.923037:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498611.923037:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498611.923038:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498611.923039:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498611.923040:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498611.923041:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498611.923042:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789498611.924213:0:15005:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789498611.924243:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885630976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789498611.924444:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498611.924517:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea874a8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498611.925240:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885630976 00000100:00100000:1.0:1789498611.925362:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885630976 00000100:00100000:1.0:1789498611.925423:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789498611.925432:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:15005:x1876424885630976:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789498611.925490:0:14316:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789498611.925493:0:14316:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789498611.925497:0:14316:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789498611.946485:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:15005:x1876424885630976:12345-0@lo:253:mount.lustre.0 Request processed in 21046us (22033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498611.946499:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789498611.946739:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885630976:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498611.946754:0:15005:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789498611.946758:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498611.946759:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789498611.946761:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498611.946762:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498611.946763:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498611.946764:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498611.946766:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498611.946767:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498611.946769:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789498611.946787:0:15005:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e98441a800 from lustre-OST0000 10000000:01000000:3.0:1789498611.946812:0:15005:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789498611.946814:0:15005:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789498611.946834:0:15005:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e98443cd40 local copy 00010000:00010000:3.0:1789498611.946845:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498611.947060:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498611.947173:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498611.947198:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea874a8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498611.948237:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885631104 00000100:00100000:0.0:1789498611.948257:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885631104 00000100:00100000:0.0:1789498611.948312:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789498611.948323:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:15005:x1876424885631104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498611.948534:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:15005:x1876424885631104:12345-0@lo:501:mount.lustre.0 Request processed in 213us (1360us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789498611.948550:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789498611.948766:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631104:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789498611.948784:0:15005:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789498611.948954:0:15005:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789498611.948963:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498611.948974:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498611.948997:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e98441a800 10000000:01000000:1.0:1789498611.949002:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789498611.949007:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98e98443cd40 10000000:01000000:1.0:1789498611.949010:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789498611.949014:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98e98443cd40 from 1 10000000:01000000:1.0:1789498611.949017:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789498611.949046:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498611.949055:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498611.949064:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498611.949146:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498611.949203:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498611.949241:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498611.949360:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885631232 00000100:00100000:2.0:1789498611.949366:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885631232 00000100:00100000:2.0:1789498611.949392:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789498611.949400:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+12:15005:x1876424885631232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498611.949410:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498611.949423:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea91099000/0x3a6cb1946bc192eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc192e4 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498611.949444:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91099000/0x3a6cb1946bc192eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc192e4 expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498611.949454:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea91099000/0x3a6cb1946bc192eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc192e4 expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498611.949462:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099000, rc 0) 00000100:00100000:2.0:1789498611.949503:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+13:15005:x1876424885631232:12345-0@lo:101:mount.lustre.0 Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498611.949509:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789498611.950145:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498611.950162:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192eb expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498611.950172:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc192eb expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498611.950190:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789498611.950202:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192eb expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498611.950221:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192eb expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498611.950228:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789498611.950233:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789498611.950238:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789498611.950240:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789498611.950269:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498611.950278:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498611.950285:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498611.950310:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498611.950345:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498611.950367:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498611.950494:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885631360 00000100:00100000:2.0:1789498611.950500:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885631360 00000100:00100000:2.0:1789498611.950526:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789498611.950533:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+13:15005:x1876424885631360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498611.950549:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498611.950573:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc192f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc192f2 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498611.950590:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc192f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc192f2 expref: 14 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498611.950599:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc192f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc192f2 expref: 14 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498611.950607:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099800, rc 0) 00000100:00100000:2.0:1789498611.950654:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631360:12345-0@lo:101:mount.lustre.0 Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498611.950660:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498611.951054:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498611.951078:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498611.951087:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498611.954116:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789498611.956155:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498611.960738:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789498611.960845:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789498611.960886:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789498611.960936:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789498611.961002:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789498611.961041:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789498611.962866:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789498611.962886:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789498611.962992:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498611.963057:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498611.963150:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498611.963350:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885631488 00000100:00100000:0.0:1789498611.963360:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885631488 00000100:00100000:0.0:1789498611.963414:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789498611.963424:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498611.963810:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631488:12345-0@lo:501:mount.lustre.0 Request processed in 387us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498611.963819:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789498611.964721:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498611.964775:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498611.964838:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498611.964877:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498611.964998:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885631616 00000100:00100000:0.0:1789498611.965004:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885631616 00000100:00100000:0.0:1789498611.965050:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789498611.965060:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498611.965949:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631616:12345-0@lo:503:mount.lustre.0 Request processed in 885us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498611.965958:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498611.966964:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631616:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498611.968138:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498611.968235:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498611.968321:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498611.968545:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498611.974491:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885631744 00000100:00100000:3.0:1789498611.974511:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885631744 00000100:00100000:3.0:1789498611.974598:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498611.974607:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498611.974947:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631744:12345-0@lo:502:mount.lustre.0 Request processed in 340us (6625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498611.974955:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789498611.975572:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498611.975872:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789498611.975936:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789498611.975971:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789498611.976026:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789498611.976077:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789498611.976162:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789498611.976387:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789498611.976429:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789498611.976466:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789498611.976517:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789498611.976555:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789498611.976620:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789498611.982770:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498611.982866:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498611.982963:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498611.987581:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885631872 00000100:00100000:0.0:1789498611.987598:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885631872 00000100:00100000:0.0:1789498611.987678:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789498611.987690:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498611.987965:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885631872:12345-0@lo:502:mount.lustre.0 Request processed in 277us (5098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498611.987973:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789498611.988214:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885631872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498611.988357:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789498611.988375:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789498611.989860:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789498611.989871:0:15019:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789498611.989877:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498611.989880:0:15019:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789498611.989885:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498611.989901:0:15019:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98eabb558000) 00000020:00000080:1.0:1789498611.989922:0:15019:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789498611.989928:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789498611.990003:0:15019:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e98441a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789498611.990011:0:15019:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789498611.990018:0:15019:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3a6cb1946bc19307 00010000:00010000:1.0:1789498611.997898:0:15019:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789498611.998474:0:15019:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789498612.001939:0:15019:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789498612.004032:0:15019:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789498612.004043:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498612.004049:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.004051:0:15019:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789498612.004056:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789498612.004059:0:15019:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1789498612.004061:0:15019:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789498612.004063:0:15019:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789498612.004075:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789498612.004078:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.004079:0:15019:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789498612.004082:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498612.004085:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.004087:0:15019:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789498612.004116:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789498612.004118:0:15019:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789498612.004120:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498612.004123:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.004133:0:15019:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789498612.004136:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498612.004138:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.004140:0:15019:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789498612.004143:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789498612.004202:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498612.004212:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.004221:0:15019:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789498612.004225:0:15019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789498612.008896:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789498612.008943:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789498612.008965:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.008979:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498612.008989:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e98441a800 from 1 10000000:01000000:1.0:1789498612.008993:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789498612.009033:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.009042:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.009052:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498612.009087:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498612.009227:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498612.009276:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789498612.009551:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885632000 00000100:00100000:3.0:1789498612.009570:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885632000 00000100:00100000:3.0:1789498612.009623:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789498612.009632:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:15005:x1876424885632000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498612.009772:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498612.009787:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1930e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498612.009814:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 15 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498612.009824:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 15 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498612.009832:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90a00, rc 0) 00000100:00100000:3.0:1789498612.009898:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632000:12345-0@lo:101:mount.lustre.0 Request processed in 267us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498612.009905:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789498612.009993:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498612.010009:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.010019:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498612.010599:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789498612.011409:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498612.011815:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789498612.012060:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789498612.012467:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789498612.012478:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789498612.012715:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498612.012774:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.012850:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498612.023807:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885632128 00000100:00100000:1.0:1789498612.023822:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885632128 00000100:00100000:1.0:1789498612.023877:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789498612.023888:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498612.024955:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632128:12345-0@lo:501:mount.lustre.0 Request processed in 1065us (12176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498612.024966:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789498612.025399:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498612.025453:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498612.025505:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.025540:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498612.025941:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885632256 00000100:00100000:1.0:1789498612.025948:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885632256 00000100:00100000:1.0:1789498612.025988:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789498612.025995:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498612.026834:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632256:12345-0@lo:503:mount.lustre.0 Request processed in 838us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498612.026842:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789498612.026971:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498612.029730:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498612.029818:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498612.029890:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.029937:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498612.030037:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885632384 00000100:00100000:1.0:1789498612.030044:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885632384 00000100:00100000:1.0:1789498612.031676:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789498612.031697:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498612.031948:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632384:12345-0@lo:502:mount.lustre.0 Request processed in 259us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498612.032002:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498612.032611:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789498612.032683:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789498612.032732:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789498612.032766:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789498612.032794:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789498612.032831:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789498612.032861:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789498612.032889:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789498612.032922:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498612.032971:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.033011:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789498612.033447:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885632512 00000100:00100000:3.0:1789498612.033454:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885632512 00000100:00100000:1.0:1789498612.033593:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498612.033822:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789498612.033831:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498612.034008:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632512:12345-0@lo:502:mount.lustre.0 Request processed in 178us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498612.034016:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789498612.034112:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498612.034235:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789498612.034247:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789498612.035405:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498612.035415:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.035418:0:15023:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789498612.035423:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e98441a800 00000020:00000080:2.0:1789498612.035425:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498612.035432:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498612.035434:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.035435:0:15023:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789498612.035438:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498612.035440:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.035441:0:15023:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789498612.035444:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e98441a800 00000020:00000080:2.0:1789498612.035446:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498612.035502:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498612.035505:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.035517:0:15023:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789498612.035520:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498612.035523:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.035524:0:15023:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789498612.035528:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e98441a800 00000020:00000080:2.0:1789498612.035530:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498612.035631:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498612.035702:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498612.035704:0:15023:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789498612.035707:0:15023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789498612.035841:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789498612.035862:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789498612.035882:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.035893:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498612.035931:0:15005:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789498612.035933:0:15005:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e98441a800 10000000:01000000:1.0:1789498612.035942:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e98441a800 10000000:01000000:1.0:1789498612.035946:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789498612.035951:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e98441a800 from 1 10000000:01000000:1.0:1789498612.035954:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789498612.035984:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.035992:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.036003:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498612.036025:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498612.037756:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498612.037814:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498612.037918:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885632640 00000100:00100000:2.0:1789498612.037928:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885632640 00000100:00100000:2.0:1789498612.037975:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789498612.037984:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885632640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498612.037999:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498612.038016:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc19323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1931c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.038043:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc19323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1931c expref: 16 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.038053:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc19323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1931c expref: 16 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.038062:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91099e00, rc 0) 00000100:00100000:2.0:1789498612.038340:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885632640:12345-0@lo:101:mount.lustre.0 Request processed in 355us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498612.038346:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789498612.038777:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498612.038796:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.038806:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498612.044351:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789498612.046796:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498612.047142:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789498612.047194:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789498612.047711:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789498612.047841:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789498612.047885:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789498612.047941:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789498612.048005:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789498612.048047:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789498612.050825:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789498612.050917:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789498612.050957:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789498612.051014:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789498612.051054:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789498612.052912:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789498612.053053:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789498612.053127:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789498612.053169:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789498612.053239:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789498612.056039:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789498612.056151:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789498612.058867:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789498612.058975:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789498612.061913:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789498612.061999:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789498612.062034:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789498612.062075:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789498612.062367:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789498612.062402:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789498612.062480:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789498612.062487:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789498612.064953:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498612.065023:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.065082:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498612.065343:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885632768 00000100:00100000:0.0:1789498612.065352:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885632768 00000100:00100000:0.0:1789498612.065405:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789498612.065414:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885632768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498612.066536:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885632768:12345-0@lo:501:mount.lustre.0 Request processed in 1119us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498612.066545:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789498612.066699:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498612.067223:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498612.067504:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.067536:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88240 going to sleep for 11 seconds 00000100:00100000:1.0:1789498612.067694:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885632896 00000100:00100000:1.0:1789498612.067701:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885632896 00000100:00100000:1.0:1789498612.068074:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789498612.068085:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885632896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498612.069187:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885632896:12345-0@lo:503:mount.lustre.0 Request processed in 1100us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498612.069197:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789498612.069829:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885632896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498612.073026:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498612.075235:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885633024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498612.079208:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.079269:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498612.079447:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885633024 00000100:00100000:0.0:1789498612.079458:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885633024 00000100:00100000:0.0:1789498612.079517:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789498612.079528:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885633024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498612.080259:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885633024:12345-0@lo:502:mount.lustre.0 Request processed in 729us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498612.080268:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789498612.082283:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885633024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498612.082663:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789498612.082938:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789498612.082983:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789498612.083034:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789498612.083125:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789498612.083220:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789498612.083277:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789498612.083317:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789498612.083372:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789498612.083413:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789498612.083453:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789498612.083503:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789498612.083535:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789498612.083583:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789498612.083658:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789498612.083699:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789498612.087954:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789498612.088127:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789498612.088173:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789498612.090949:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789498612.091056:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789498612.092457:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789498612.092530:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789498612.094435:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789498612.094517:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789498612.100907:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789498612.101083:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789498612.101145:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789498612.101188:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789498612.101265:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789498612.101302:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789498612.101338:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789498612.101377:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789498612.101431:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789498612.101473:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789498612.101518:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789498612.101549:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789498612.101594:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789498612.101851:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789498612.101889:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789498612.101933:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885633152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498612.102005:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.102042:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad88240 going to sleep for 11 seconds 00000100:00100000:1.0:1789498612.102197:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885633152 00000100:00100000:1.0:1789498612.102222:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885633152 00000100:00100000:1.0:1789498612.102284:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789498612.102293:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885633152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498612.102525:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885633152:12345-0@lo:502:mount.lustre.0 Request processed in 232us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498612.102532:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789498612.102963:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885633152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498612.103051:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789498612.103074:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789498612.106548:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789498612.106706:0:15028:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98eabb55cd40) 00000020:00000080:1.0:1789498612.106801:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789498612.107002:0:15028:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e98441a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789498612.107007:0:15028:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e98441a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789498612.107010:0:15028:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e98441a800 3 00010000:00080000:1.0:1789498612.107039:0:15028:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e987722800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1789498612.116847:0:15028:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789498612.117059:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789498612.117117:0:15028:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789498612.117130:0:15028:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3a6cb1946bc19331 00000100:00080000:1.0:1789498612.117140:0:15028:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789498612.117154:0:15028:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98e987722800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1789498612.117191:0:15028:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e98649f800 x1876424885633280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498612.117232:0:15028:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789498612.117425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498612.117431:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498612.117444:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498612.117446:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498612.118343:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885633280:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498612.118414:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498612.118475:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885633280 00000100:00100000:3.0:1789498612.118483:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885633280 00000100:00100000:3.0:1789498612.118514:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498612.118520:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876424885633280:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789498612.118545:0:14325:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:3.0:1789498612.118577:0:14325:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3a6cb1946bc19338 00000004:00100000:3.0:1789498612.118591:0:14325:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789498612.118620:0:14325:0:(import.c:65:import_set_state_nolock()) ffff98ea90a2c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498612.119153:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876424885633280:12345-0@lo:38:llog_process_th.0 Request processed in 630us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498612.119161:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789498612.119205:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e98649f800 x1876424885633280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498612.119216:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789498612.119232:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789498612.119240:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789498612.119244:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789498612.119247:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e987722800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789498612.119253:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885633280:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789498612.123005:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789498612.123691:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789498612.123740:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789498612.123765:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.123786:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789498612.123833:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789498612.123835:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498612.123837:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498612.123838:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498612.123839:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498612.123841:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498612.123842:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498612.123845:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498612.123846:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498612.123850:0:15005:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789498612.123852:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789498612.123854:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498612.123855:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498612.123856:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498612.123857:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498612.123858:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498612.123859:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498612.123861:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498612.123862:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498612.123887:0:15005:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789498612.123907:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885633408:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789498612.123976:0:15005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.124015:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabad880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498612.124052:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885633408 00000100:00100000:2.0:1789498612.124061:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885633408 00000100:00100000:2.0:1789498612.124135:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789498612.124144:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15005:x1876424885633408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789498612.124181:0:14318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789498612.124194:0:14318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1789498612.142514:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1789498612.161844:0:14318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789498612.161863:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789498612.162352:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789498612.162358:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789498612.162380:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.162399:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.162407:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.162450:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498612.162463:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 16 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498612.162477:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1876424885633536:0@lo:104: 00000100:00100000:2.0:1789498612.162548:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498612.162599:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcf000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498612.163045:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885633536 00000100:00100000:1.0:1789498612.163055:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885633536 00000100:00100000:1.0:1789498612.163125:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498612.163134:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:14339:x1876424885633536:12345-0@lo:104: 00010000:00010000:1.0:1789498612.163146:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163236:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789498612.163243:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:14339:x1876424885633536:12345-0@lo:104: Request processed in 111us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498612.163258:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498612.163299:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1876424885633536:0@lo:104: 00010000:00010000:1.0:1789498612.163318:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163335:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498612.163340:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163347:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498612.163351:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163360:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498612.163368:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498612.163374:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789498612.163401:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163406:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498612.163424:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163440:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4600/0x3a6cb1946bc192a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc192ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163456:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498612.163458:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498612.163460:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498612.163482:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885633664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498612.163513:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498612.163569:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885633664 00000100:00100000:1.0:1789498612.163573:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885633664 00010000:00010000:1.0:1789498612.163589:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 17 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498612.163608:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498612.163614:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:3307:x1876424885633664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498612.163649:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498612.163656:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 17 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163666:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 17 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163679:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91098200/0x3a6cb1946bc192ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc192a5 expref: 17 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163691:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163708:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789498612.163721:0:14309:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001364538s 00010000:00010000:1.0:1789498612.163726:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163733:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163739:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163746:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163752:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498612.163756:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163763:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163775:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163784:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498612.163812:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3307:x1876424885633664:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498612.163820:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789498612.163847:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163855:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498612.163860:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91098e00/0x3a6cb1946bc1933f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498612.163882:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885633664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498612.174379:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:15005:x1876424885633408:12345-0@lo:253:mount.lustre.0 Request processed in 50226us (50393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498612.174394:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789498612.174598:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15005:1876424885633408:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498612.174614:0:15005:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789498612.174618:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498612.174620:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789498612.174621:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498612.174622:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498612.174623:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498612.174625:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498612.174626:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498612.174628:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498612.174630:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789498612.174717:0:15005:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789498612.181726:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498612.181910:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789498612.182080:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498612.182326:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789498612.182469:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498612.182817:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789498612.183839:0:15005:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789498612.263128:0:15005:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789498612.263138:0:15005:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789498612.263177:0:15005:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789498612.263232:0:15005:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789498612.263247:0:15005:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789498612.263275:0:15005:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789498613.164384:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789498613.931720:0:14320:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789498613.931730:0:14320:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98eaba3b0800 from 7 10000000:01000000:1.0:1789498613.931736:0:14320:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789498613.931792:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498613.931806:0:14320:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498613.931817:0:14320:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498613.931846:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885633792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789498613.935511:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498613.935586:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea874a8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498613.935948:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885633792 00000100:00100000:2.0:1789498613.935958:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885633792 00000100:00100000:2.0:1789498613.936014:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789498613.936026:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:14320:x1876424885633792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498613.936133:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498613.936157:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19346 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498613.936185:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498613.936197:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498613.936206:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea91098a00, rc 0) 00000100:00100000:2.0:1789498613.936261:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:14320:x1876424885633792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498613.936267:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789498613.936394:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885633792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498613.936413:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498613.936422:0:14320:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498613.936492:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885633920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789498613.936540:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498613.936569:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498613.936791:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885633920 00000100:00100000:2.0:1789498613.936796:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885633920 00000100:00100000:2.0:1789498613.936828:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789498613.936835:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:14320:x1876424885633920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789498613.936850:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789498613.936974:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789498613.936978:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789498613.937110:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:14320:x1876424885633920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 252us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498613.937119:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789498613.937250:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885633920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789498613.937323:0:14320:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789498613.937331:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498613.937340:0:14320:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498614.197667:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498615.211335:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498616.235283:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498617.262151:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498617.323259:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498617.323267:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498617.323270:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498617.323273:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498617.323337:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885634176:0@lo:400:kworker.0 00000100:00100000:0.0:1789498617.323407:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498617.323478:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498617.323485:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885634304:0@lo:400:kworker.0 00000100:00100000:0.0:1789498617.323511:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498617.323569:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885634176 00000100:00100000:0.0:1789498617.323577:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885634176 00000100:00100000:0.0:1789498617.323620:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885634304 00000100:00100000:0.0:1789498617.323623:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885634304 00000100:00100000:0.0:1789498617.323654:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498617.323663:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885634176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498617.323713:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885634176:12345-0@lo:400:kworker.0 Request processed in 51us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498617.323732:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498617.323753:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498617.323760:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885634304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498617.323787:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885634304:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498617.323792:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789498617.323831:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eaba23b800 x1876424885634304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498617.323846:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885634304:0@lo:400:kworker.0 00010000:00080000:0.0:1789498617.323857:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eaba239500 x1876424885634176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498617.323866:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885634176:0@lo:400:kworker.0 00000100:00080000:0.0:1789498617.323914:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498617.324109:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498617.324120:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885634048:0@lo:400:kworker.0 00000100:00100000:3.0:1789498617.324158:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498617.325646:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885634048 00000100:00100000:0.0:1789498617.325657:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885634048 00000100:00100000:0.0:1789498617.325701:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789498617.325709:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3307:x1876424885634048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498617.325773:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3307:x1876424885634048:12345-0@lo:400:kworker.0 Request processed in 65us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498617.325780:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789498617.325834:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885634048:0@lo:400:kworker.0 00010000:00010000:2.0:1789498618.283656:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498618.667855:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789498619.314620:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498620.333701:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789498620.366458:0:15374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789498621.355268:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498621.356280:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498606/real 1789498606] req@ffff98eabb4a4380 x1876424885629952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498621.356312:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98eabb4a4380 x1876424885629952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498621.356321:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498606/real 1789498606] req@ffff98eabb4a7480 x1876424885630080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498621.356332:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98eabb4a7480 x1876424885630080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789498621.356348:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98eaba5d5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498621.356372:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789498621.356377:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885629952:0@lo:8:kworker.0 00000100:00080000:3.0:1789498621.356383:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498621.356388:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789498621.356391:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885630080:0@lo:8:kworker.0 00000100:00080000:2.0:1789498621.356503:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498621.356507:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789498621.356510:0:37:0:(import.c:65:import_set_state_nolock()) ffff98eaba5d5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498621.356514:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1789498621.356520:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789498621.356530:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98eaba5d5000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498621.356551:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabaa8ea00 x1876424885634560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498621.356565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498621.356568:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789498621.356570:0:37:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498621.356573:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1789498621.356576:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789498621.356580:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea82998800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498621.356591:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabaa8c700 x1876424885634688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789498621.356635:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885634816:0@lo:400:kworker.0 00000100:00100000:2.0:1789498621.356703:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498621.356754:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498621.356761:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885634432:0@lo:400:kworker.0 00000100:00100000:2.0:1789498621.356790:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498621.356821:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885634944:0@lo:400:kworker.0 00000100:00100000:2.0:1789498621.356847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498621.356889:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885634816 00000100:00100000:2.0:1789498621.356906:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885634816 00000100:00100000:2.0:1789498621.356953:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885634944 00000100:00100000:2.0:1789498621.356957:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885634944 00000100:00100000:2.0:1789498621.356983:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498621.356991:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885634816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498621.357044:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885634816:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498621.357052:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498621.357070:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498621.357075:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885634944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498621.357132:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885634944:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498621.357138:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498621.357157:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885634432 00000100:00100000:2.0:1789498621.357160:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885634432 00000100:00100000:2.0:1789498621.357183:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789498621.357189:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3308:x1876424885634432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498621.357217:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3308:x1876424885634432:12345-0@lo:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498621.357222:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789498621.357256:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789498621.357289:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabaa8df80 x1876424885634944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498621.357301:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885634944:0@lo:400:kworker.0 00000100:00100000:2.0:1789498621.357321:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885634560:0@lo:8:kworker.0 00000100:00100000:2.0:1789498621.357346:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498621.357367:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885634688:0@lo:8:kworker.0 00000100:00100000:2.0:1789498621.357395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498621.357425:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885634432:0@lo:400:kworker.0 00010000:00080000:2.0:1789498621.357435:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabaa8ce00 x1876424885634816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498621.357444:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885634816:0@lo:400:kworker.0 00000100:00100000:3.0:1789498621.357701:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885634560 00000100:00100000:3.0:1789498621.357705:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885634560 00000100:00100000:3.0:1789498621.357734:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885634688 00000100:00100000:3.0:1789498621.357738:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885634688 00000100:00100000:3.0:1789498621.357749:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498621.357754:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885634560:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789498621.357777:0:15006:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1789498621.357805:0:15006:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc19354 00002000:00100000:3.0:1789498621.357818:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98ea88a95800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789498621.357822:0:15006:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789498621.357826:0:15006:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789498621.358208:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789498621.358235:0:15006:0:(import.c:65:import_set_state_nolock()) ffff98ea88a97800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498621.358281:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876424885634560:12345-0@lo:8:kworker.0 Request processed in 524us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498621.358287:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498621.358304:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498621.358308:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885634688:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789498621.358317:0:15006:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789498621.358342:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885634688:12345-0@lo:8:kworker.0 Request processed in 33us (946us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789498621.358348:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789498621.358654:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabaa8ea00 x1876424885634560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498621.358665:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789498621.358671:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789498621.358679:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789498621.358684:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789498621.358686:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98eaba5d5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789498621.358709:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789498621.358715:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885634560:0@lo:8:kworker.0 00000100:00080000:2.0:1789498621.358728:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498621.358732:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789498621.358735:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885634688:0@lo:8:kworker.0 00000004:00080000:1.0:1789498621.358828:0:14345:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789498621.358848:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14345:1876424885635200:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789498621.358886:0:14345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498621.358920:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f5c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498621.358934:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498621.358943:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885635072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498621.358968:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498621.359004:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885635072 00000100:00100000:1.0:1789498621.359009:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885635072 00000100:00100000:1.0:1789498621.359051:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498621.359058:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885635072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498621.359115:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498621.359156:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885635072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498621.359162:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789498621.359178:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789498621.359197:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e98649ed80 x1876424885635072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498621.359213:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885635072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498621.359244:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885635200 00000100:00100000:1.0:1789498621.359249:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885635200 00000100:00100000:1.0:1789498621.359274:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498621.359298:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14345:x1876424885635200:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789498621.360200:0:14344:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789498621.360445:0:14344:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 521124354029ns, next at 0ns, rc = 0 00002000:00080000:1.0:1789498621.373399:0:15006:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789498621.373411:0:15006:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789498621.373418:0:15006:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1789498621.391532:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.391541:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.391555:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.391559:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.391563:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.391575:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.391583:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.391588:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.391605:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498621.391627:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498621.391635:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.391649:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498621.391654:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.391663:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.391682:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.391689:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9604c80/0x3a6cb1946bc1935b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.391703:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498621.391705:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498621.391707:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498621.392474:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.392483:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392503:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.392508:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.392512:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392522:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392530:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392537:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392551:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498621.392560:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498621.392565:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392571:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498621.392574:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392580:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392601:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392607:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc19362 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.392619:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.392620:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.392622:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498621.393363:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.393372:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.393382:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.393386:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.393459:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.393470:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.393480:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.393488:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.393516:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498621.393758:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498621.393765:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.393773:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498621.393777:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.393786:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.393807:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.393814:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b308a8c0/0x3a6cb1946bc19369 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.393828:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498621.393830:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498621.393832:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498621.394057:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.394063:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394073:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.394076:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.394080:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394107:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394116:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394123:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394136:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498621.394145:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498621.394149:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394156:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498621.394165:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394173:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394184:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394191:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bcbc07c/0x3a6cb1946bc19370 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394204:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.394206:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.394208:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498621.394822:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.394829:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394840:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.394843:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.394848:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394858:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394867:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394882:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.394951:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498621.395409:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.395415:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.395425:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.395429:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.395433:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.395443:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.395451:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.395459:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395562:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498621.395570:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395578:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.395583:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395602:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395617:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395625:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a76beb5e/0x3a6cb1946bc19377 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395641:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.395645:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395651:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddec00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.395654:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395663:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395673:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.395680:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.395682:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.395688:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.395854:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789498621.395860:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26537e3/0x3a6cb1946bc1937e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498621.396479:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.396486:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.396496:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.396500:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.396505:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.396515:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.396522:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.396530:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.396982:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.396990:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.397000:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfa00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.397004:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.397013:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.397028:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.397037:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.397039:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.397042:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.397272:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789498621.397279:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fc61e94/0x3a6cb1946bc19385 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.398261:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498621.401525:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.401539:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.401564:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.401569:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.401575:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.401589:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.401599:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.401607:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.401621:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498621.401804:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.401812:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.401821:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.401826:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.401836:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.401875:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.401884:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452d4226/0x3a6cb1946bc1938c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.401912:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.401914:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.401916:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498621.402846:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.402855:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.402866:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.402870:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.402876:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.402886:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.402917:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.402924:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.402979:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498621.403410:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498621.403416:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.403426:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=521s v=(0 0) 00010000:00010000:1.0:1789498621.403429:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498621.403433:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.403442:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.403451:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.403457:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412044:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498621.412059:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412075:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.412080:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412104:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412130:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412138:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb8de8a/0x3a6cb1946bc19393 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412174:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.412178:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412185:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfe00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.412188:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412196:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412207:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.412214:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.412216:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.412217:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.413503:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789498621.413513:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004053e3c2/0x3a6cb1946bc1939a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.413696:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.414679:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.414689:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.414704:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.415536:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.415543:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.415571:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.415582:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.415591:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.415618:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498621.416147:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.416154:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416165:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.416169:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.416174:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416183:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416191:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416209:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416225:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498621.416237:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498621.416242:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416250:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.416254:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416264:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416280:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416288:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c258155/0x3a6cb1946bc193a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416303:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.416307:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416322:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.416326:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416334:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416343:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416350:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8a9aef9/0x3a6cb1946bc193a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416360:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.416361:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.416363:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.416731:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.416737:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416747:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.416750:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.416755:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416764:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416778:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416785:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416797:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498621.416804:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.416808:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416813:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.416815:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416822:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416832:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416839:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e996b8ab/0x3a6cb1946bc193af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.416852:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.416858:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.416859:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.417258:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.417264:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417273:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.417276:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.417280:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417289:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417297:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417304:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417315:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498621.417322:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.417326:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417332:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.417336:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417353:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417363:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417369:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a03d705b/0x3a6cb1946bc193b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417382:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.417383:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.417385:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.417729:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.417735:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417743:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.417746:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.417749:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417758:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417766:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417777:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417788:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498621.417795:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.417799:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417806:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.417809:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417817:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417827:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417834:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd1b4eb9/0x3a6cb1946bc193bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.417845:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.417847:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.417848:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.418233:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.418244:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418251:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.418254:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.418259:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418268:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418277:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418283:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418294:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498621.418301:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.418304:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418309:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91099400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.418313:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418319:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418333:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418339:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000773a8f54/0x3a6cb1946bc193c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418350:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.418351:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.418353:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.418700:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.418705:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418713:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.418716:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.418720:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418728:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418735:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418742:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418762:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498621.418770:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.418773:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418779:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.418782:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418790:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418800:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418806:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7ceb99/0x3a6cb1946bc193cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.418818:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.418820:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.418821:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.422373:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.424510:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.424533:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.424552:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.424561:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.424570:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.424587:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.424598:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.424606:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.424630:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498621.425061:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498621.425069:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.425078:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498621.425083:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.425115:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.425135:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.425143:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f761791/0x3a6cb1946bc193d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.425171:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498621.425172:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498621.425174:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.425448:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.425455:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.425464:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.425467:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.425471:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.425481:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.425489:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.425503:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.425520:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498621.425960:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.425966:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.425975:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.425978:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.425983:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.425992:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426000:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426007:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426023:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789498621.426343:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498621.426350:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426375:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea91098e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498621.426379:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426396:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789498621.426403:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.426408:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426412:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426420:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=521s v=(0 0) 00010000:00010000:0.0:1789498621.426421:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f46a1a5/0x3a6cb1946bc193d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426423:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.426428:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426436:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426437:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498621.426440:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426445:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426446:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498621.426450:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426453:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426457:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426461:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498621.426466:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426478:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc193e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426490:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498621.426493:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426499:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498621.426502:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426510:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426521:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426528:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc193e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.426539:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498621.426541:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498621.426543:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.426823:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.426829:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426837:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.426839:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.426843:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426852:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426869:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.426876:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.427507:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498621.427952:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498621.427959:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.427969:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498621.427973:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.427981:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.427996:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.428004:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc193ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.428022:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498621.428024:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498621.428025:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.428165:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.428172:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428182:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.428185:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.428190:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428201:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428210:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428218:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428379:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498621.428444:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498621.428450:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.428458:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498621.428461:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.428469:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.428480:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.428487:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc193f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498621.428501:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.428503:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.428505:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498621.428789:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.428795:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428804:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.428807:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.428811:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428820:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428828:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428836:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.428983:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498621.429383:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.429389:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.429398:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.429407:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.429411:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.429421:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.429430:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.429443:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789498621.429715:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789498621.432059:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789498621.432801:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498621.432811:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.432829:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=521s v=(0 0) 00010000:00010000:2.0:1789498621.432833:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498621.432839:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.432853:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.432862:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.432877:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.432888:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789498621.433411:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789498621.433420:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.433436:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498621.433441:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.433450:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.433468:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498621.433475:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dae647a/0x3a6cb1946bc193fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498621.433600:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789498621.433607:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.433622:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1789498621.433625:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498621.433629:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.433639:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.433648:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.433656:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.433665:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789498621.434167:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789498621.434173:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434182:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.434185:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434194:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434205:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434212:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19403 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434227:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498621.434230:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434246:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.434249:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434256:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434265:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434273:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc1940a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434286:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.434289:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434295:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.434299:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434306:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434316:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434329:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19411 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434342:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.434343:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.434345:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498621.434451:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789498621.434458:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.434466:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1789498621.434470:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498621.434475:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.434484:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.434504:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.434512:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498621.434526:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498621.434575:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498621.434580:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434588:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498621.434591:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434599:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434609:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498621.434616:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004197e331/0x3a6cb1946bc19418 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789498621.434694:0:15006:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:2.0:1789498621.434800:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.434802:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498621.434804:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498621.434865:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14345:x1876424885635200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 75564us (75974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498621.434874:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498621.434979:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14345:1876424885635200:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789498621.434996:0:14345:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789498621.435327:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14345:1876424885635328:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1789498621.435534:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498621.435549:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498621.435933:0:14345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498621.435977:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498621.436033:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885635328 00000100:00100000:1.0:1789498621.436040:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885635328 00000100:00100000:3.0:1789498621.436256:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498621.436267:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14345:x1876424885635328:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789498621.436310:0:15007:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1789498621.445322:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14345:x1876424885635328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9049us (9949us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789498621.445336:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498621.445674:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14345:1876424885635328:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789498621.445694:0:14345:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789498622.392804:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789498622.684566:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789498622.684605:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789498623.404420:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498624.429449:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498625.459107:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498626.477197:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498626.543050:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885635456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498626.543157:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498626.544787:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885635456 00000100:00100000:3.0:1789498626.544813:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885635456 00000100:00100000:3.0:1789498626.544912:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498626.544923:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885635456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498626.544973:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498626.545061:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885635456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498626.545068:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498626.545138:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789498626.545167:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885635456:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789498626.545463:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498626.546917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498626.546923:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498626.546927:0:37:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498626.546934:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1789498626.546941:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789498626.546954:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea82998800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498626.546979:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb4a5c00 x1876424885635712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498626.547066:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885635840:0@lo:400:kworker.0 00000100:00100000:3.0:1789498626.547164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498626.547203:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498626.547209:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885635968:0@lo:400:kworker.0 00000100:00100000:3.0:1789498626.547234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498626.547459:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885635712:0@lo:8:kworker.0 00000100:00100000:2.0:1789498626.547494:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498626.547543:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885635840 00000100:00100000:2.0:1789498626.547551:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885635840 00000100:00100000:2.0:1789498626.547604:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885635968 00000100:00100000:2.0:1789498626.547608:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885635968 00000100:00100000:2.0:1789498626.547634:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498626.547642:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885635840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498626.547693:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885635840:12345-0@lo:400:kworker.0 Request processed in 51us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498626.547700:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498626.547715:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498626.547722:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885635968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498626.547750:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885635968:12345-0@lo:400:kworker.0 Request processed in 29us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498626.547756:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789498626.547776:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789498626.547802:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb4a7100 x1876424885635968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498626.547824:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885635968:0@lo:400:kworker.0 00010000:00080000:2.0:1789498626.547837:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb4a4a80 x1876424885635840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498626.547866:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885635840:0@lo:400:kworker.0 00000100:00100000:1.0:1789498626.548003:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885635584:0@lo:400:kworker.0 00000100:00100000:1.0:1789498626.548052:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498626.548418:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885635712 00000100:00100000:3.0:1789498626.548424:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885635712 00000100:00100000:3.0:1789498626.548457:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498626.548463:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885635712:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789498626.548495:0:15006:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789498626.552693:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885635584 00000100:00100000:2.0:1789498626.552709:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885635584 00000100:00100000:2.0:1789498626.552781:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789498626.552793:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3308:x1876424885635584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498626.552902:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3308:x1876424885635584:12345-0@lo:400:kworker.0 Request processed in 111us (4847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498626.552909:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789498626.552969:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885635584:0@lo:400:kworker.0 00000100:00100000:2.0:1789498626.595600:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885635712:12345-0@lo:8:kworker.0 Request processed in 47126us (48095us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789498626.595621:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789498626.595677:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498626.595682:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789498626.595697:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885635712:0@lo:8:kworker.0 00010000:00010000:1.0:1789498627.500468:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498628.532764:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498628.908436:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789498629.547281:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789498629.664626:0:15727:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789498629.664634:0:15727:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789498629.664798:0:15727:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98eabfb3d800 00000020:01000004:3.0:1789498629.664821:0:15727:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789498629.664837:0:15727:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789498629.664855:0:15727:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98ea83f299c0) 00000020:00000080:3.0:1789498629.664876:0:15727:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789498629.706925:0:15727:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789498629.707293:0:15727:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789498629.711068:0:15727:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789498629.712975:0:15727:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789498629.713331:0:15727:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789498629.727830:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 593: rc = 0 00100000:10000000:3.0:1789498629.728156:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 593: rc = 0 00100000:10000000:3.0:1789498629.729427:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 593: rc = 0 00100000:10000000:3.0:1789498629.738011:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 675: rc = 0 00100000:10000000:3.0:1789498629.738544:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 675: rc = 0 00100000:10000000:3.0:1789498629.743325:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 675: rc = 0 00100000:10000000:3.0:1789498629.744503:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 675: rc = 0 00100000:10000000:3.0:1789498629.745017:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 675: rc = 0 00100000:10000000:2.0:1789498629.754538:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 675: rc = 0 00000020:00000080:2.0:1789498629.758130:0:15727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789498629.758155:0:15727:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789498629.758181:0:15727:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3a6cb1946bc19426 00000020:01000004:2.0:1789498629.758195:0:15727:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789498629.758226:0:15727:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789498629.758231:0:15727:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789498629.759951:0:15727:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789498629.760018:0:15727:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789498629.760026:0:15727:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789498629.780760:0:15727:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789498629.780817:0:15727:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789498629.780823:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789498629.780825:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498629.780826:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498629.780828:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498629.780829:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498629.780831:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498629.780832:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498629.780835:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498629.780836:0:15727:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498629.780842:0:15727:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789498629.780845:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789498629.780846:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498629.780848:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498629.780849:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498629.780850:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498629.780851:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498629.780852:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498629.780853:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498629.780854:0:15727:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498629.780896:0:15727:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789498629.780925:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636096:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789498629.781031:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498629.781144:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.781460:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885636096 00000100:00100000:2.0:1789498629.781470:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885636096 00000100:00100000:2.0:1789498629.781537:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789498629.781560:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15727:x1876424885636096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789498629.781619:0:14315:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789498629.781623:0:14315:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789498629.781628:0:14315:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789498629.810326:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15727:x1876424885636096:12345-0@lo:253:mount.lustre.0 Request processed in 28761us (29276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498629.810349:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789498629.810574:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636096:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789498629.810601:0:15727:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789498629.810605:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789498629.810607:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498629.810608:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498629.810610:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498629.810611:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498629.810612:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498629.810614:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498629.810617:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498629.810618:0:15727:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789498629.810649:0:15727:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98eabfb3d800 from lustre-OST0001 10000000:01000000:1.0:1789498629.810875:0:15727:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789498629.810879:0:15727:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789498629.810889:0:15727:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e98443cd40 local copy 00010000:00010000:1.0:1789498629.810906:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498629.811353:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498629.811421:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498629.811468:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.811983:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885636224 00000100:00100000:2.0:1789498629.811995:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885636224 00000100:00100000:2.0:1789498629.812067:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498629.812079:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15727:x1876424885636224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498629.813125:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15727:x1876424885636224:12345-0@lo:501:mount.lustre.0 Request processed in 1010us (1666us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789498629.813142:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789498629.813634:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636224:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789498629.813670:0:15727:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789498629.814046:0:15727:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789498629.814060:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498629.814085:0:15727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498629.814152:0:15727:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98eabfb3d800 10000000:01000000:3.0:1789498629.814158:0:15727:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789498629.814166:0:15727:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789498629.814168:0:15727:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498629.814174:0:15727:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789498629.814178:0:15727:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789498629.814224:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498629.814233:0:15727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498629.814321:0:15727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498629.814350:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498629.814416:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498629.814530:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.814653:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885636352 00000100:00100000:2.0:1789498629.814663:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885636352 00000100:00100000:2.0:1789498629.814905:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789498629.814916:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:15727:x1876424885636352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498629.814934:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498629.814954:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc19434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1942d expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498629.815009:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc19434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1942d expref: 17 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498629.815022:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc19434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1942d expref: 17 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498629.815032:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554400, rc 0) 00000100:00100000:2.0:1789498629.815084:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636352:12345-0@lo:101:mount.lustre.0 Request processed in 170us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498629.815128:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789498629.815214:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498629.815232:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498629.815256:0:15727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498629.816704:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789498629.817867:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498629.818263:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789498629.818324:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789498629.818369:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789498629.818428:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789498629.818486:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789498629.818527:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789498629.818607:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789498629.818617:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789498629.818735:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498629.819400:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498629.819492:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.819542:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885636480 00000100:00100000:2.0:1789498629.819612:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885636480 00000100:00100000:2.0:1789498629.819713:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789498629.819724:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498629.820483:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636480:12345-0@lo:501:mount.lustre.0 Request processed in 757us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498629.820493:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789498629.820593:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498629.820650:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498629.820714:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498629.821063:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526480 going to sleep for 11 seconds 00000100:00100000:1.0:1789498629.821209:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885636608 00000100:00100000:1.0:1789498629.821217:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885636608 00000100:00100000:1.0:1789498629.821328:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789498629.821337:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498629.821989:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636608:12345-0@lo:503:mount.lustre.0 Request processed in 652us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498629.821998:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789498629.822257:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789498629.823163:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789498629.823342:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498629.823417:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498629.823457:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.823545:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885636736 00000100:00100000:2.0:1789498629.823563:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885636736 00000100:00100000:2.0:1789498629.823607:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789498629.823615:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498629.823895:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636736:12345-0@lo:502:mount.lustre.0 Request processed in 280us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498629.823903:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789498629.824151:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789498629.824523:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789498629.824898:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789498629.824954:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789498629.825013:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789498629.825056:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789498629.825142:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789498629.825200:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789498629.825628:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789498629.825953:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789498629.826023:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498629.826154:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498629.826215:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.826405:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885636864 00000100:00100000:2.0:1789498629.826416:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885636864 00000100:00100000:2.0:1789498629.826537:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498629.826548:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498629.826839:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636864:12345-0@lo:502:mount.lustre.0 Request processed in 293us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498629.826847:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789498629.826946:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789498629.827055:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789498629.827067:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789498629.828332:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789498629.828343:0:15728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789498629.828352:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498629.828355:0:15728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789498629.828361:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789498629.828382:0:15728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98ea83f2b380) 00000020:00000080:3.0:1789498629.828411:0:15728:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789498629.828417:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789498629.828490:0:15728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98eabfb3d800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789498629.828500:0:15728:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789498629.828521:0:15728:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3a6cb1946bc19442 00010000:00010000:2.0:1789498629.862387:0:15728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789498629.864474:0:15728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789498629.875184:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789498629.883188:0:15728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789498629.883207:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498629.883216:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498629.883219:0:15728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789498629.883223:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498629.883229:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498629.883230:0:15728:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789498629.883390:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789498629.883393:0:15728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789498629.883398:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498629.883402:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498629.883403:0:15728:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789498629.883406:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498629.883409:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498629.883411:0:15728:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789498629.883415:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789498629.883510:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498629.883515:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498629.883516:0:15728:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789498629.883520:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789498629.885353:0:15727:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789498629.885404:0:15727:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789498629.885430:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498629.885447:0:15727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498629.885468:0:15727:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eabfb3d800 from 1 10000000:01000000:3.0:1789498629.885471:0:15727:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498629.885518:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498629.885527:0:15727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498629.885540:0:15727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498629.885583:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498629.885671:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498629.886061:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.886766:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885636992 00000100:00100000:2.0:1789498629.886779:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885636992 00000100:00100000:2.0:1789498629.886846:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789498629.886858:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:15727:x1876424885636992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498629.886886:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498629.886906:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19449 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498629.886951:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498629.886964:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498629.886974:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6555e00, rc 0) 00000100:00100000:2.0:1789498629.887043:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885636992:12345-0@lo:101:mount.lustre.0 Request processed in 186us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498629.887050:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789498629.887777:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885636992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498629.887802:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498629.887815:0:15727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498629.889015:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789498629.892966:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498629.893390:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789498629.893448:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789498629.893520:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789498629.893530:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789498629.893669:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498629.893814:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498629.893881:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498629.895375:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885637120 00000100:00100000:1.0:1789498629.895397:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885637120 00000100:00100000:1.0:1789498629.895475:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789498629.895487:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498629.895897:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637120:12345-0@lo:501:mount.lustre.0 Request processed in 411us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498629.895906:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789498629.896643:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498629.896734:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498629.896819:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498629.896866:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea8562b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.897021:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885637248 00000100:00100000:2.0:1789498629.897029:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885637248 00000100:00100000:2.0:1789498629.897072:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789498629.897083:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498629.897503:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637248:12345-0@lo:503:mount.lustre.0 Request processed in 421us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498629.897512:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789498629.898313:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637248:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789498629.904631:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789498629.905175:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498629.905317:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498629.905377:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea8562b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498629.905920:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885637376 00000100:00100000:2.0:1789498629.905933:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885637376 00000100:00100000:2.0:1789498629.906003:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789498629.906015:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498629.906433:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637376:12345-0@lo:502:mount.lustre.0 Request processed in 418us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498629.906452:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789498629.908040:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498629.908523:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789498629.909232:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789498629.909943:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789498629.909991:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789498629.910028:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789498629.910082:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789498629.910638:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789498629.910680:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789498629.910783:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498629.910901:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498629.910959:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea8562b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498629.911120:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885637504 00000100:00100000:1.0:1789498629.911131:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885637504 00000100:00100000:1.0:1789498629.911201:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498629.911211:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498629.911483:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637504:12345-0@lo:502:mount.lustre.0 Request processed in 273us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498629.911492:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789498629.911678:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498629.917028:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789498629.917060:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789498629.919689:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498629.919705:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498629.919708:0:15732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789498629.919716:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98eabfb3d800 00000020:00000080:0.0:1789498629.919718:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789498629.919727:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498629.919729:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498629.919731:0:15732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789498629.919734:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498629.919736:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498629.919737:0:15732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789498629.919741:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98eabfb3d800 00000020:00000080:0.0:1789498629.919743:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789498629.919828:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498629.928199:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498629.928213:0:15732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789498629.928245:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498629.928255:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498629.928257:0:15732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789498629.928264:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98eabfb3d800 00000020:00000080:1.0:1789498629.928268:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498629.928438:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498629.928442:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498629.928444:0:15732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789498629.928447:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789498629.938171:0:15727:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789498629.938255:0:15727:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789498629.938283:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498629.938314:0:15727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498629.938382:0:15727:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789498629.938386:0:15727:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98eabfb3d800 10000000:01000000:1.0:1789498629.938389:0:15727:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98eabfb3d800 10000000:01000000:1.0:1789498629.938395:0:15727:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789498629.938402:0:15727:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98eabfb3d800 from 1 10000000:01000000:1.0:1789498629.938405:0:15727:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789498629.938457:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498629.938465:0:15727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498629.938479:0:15727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498629.938511:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498629.938623:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498629.938680:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0dfe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498629.938731:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885637632 00000100:00100000:1.0:1789498629.938741:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885637632 00000100:00100000:1.0:1789498629.938807:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498629.938820:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885637632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498629.938838:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498629.938854:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc1945e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19457 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498629.938897:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc1945e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19457 expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498629.938910:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc1945e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19457 expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498629.938921:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf400, rc 0) 00000100:00100000:1.0:1789498629.938966:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885637632:12345-0@lo:101:mount.lustre.0 Request processed in 148us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498629.938974:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498629.939033:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498629.939050:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498629.939060:0:15727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498629.939900:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789498629.940584:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498629.940855:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789498629.940900:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789498629.940934:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789498629.940976:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789498629.941010:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789498629.941063:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789498629.941135:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789498629.941174:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789498629.941218:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789498629.941261:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789498629.941289:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789498629.941331:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789498629.941361:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789498629.941389:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789498629.941429:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789498629.941459:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789498629.941493:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789498629.941545:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789498629.941584:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789498629.941622:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789498629.941675:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789498629.968490:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789498629.968573:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789498629.968682:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789498629.968728:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789498629.968788:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789498629.968845:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789498629.968886:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789498629.968925:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789498629.968981:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789498629.969061:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789498629.969139:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789498629.969181:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789498629.969234:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789498629.969273:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789498629.969327:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789498629.969367:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789498629.969498:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789498629.969507:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789498629.969683:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498629.969820:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498629.969900:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0dfe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498629.970161:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885637760 00000100:00100000:0.0:1789498629.970172:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885637760 00000100:00100000:0.0:1789498629.970242:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789498629.970253:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885637760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498629.970549:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885637760:12345-0@lo:501:mount.lustre.0 Request processed in 297us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498629.970558:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789498629.970975:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498629.971036:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637888:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498629.976989:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498629.977130:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885637888 00000100:00100000:1.0:1789498629.977144:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885637888 00000100:00100000:1.0:1789498629.977234:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789498629.977249:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885637888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498629.977867:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885637888:12345-0@lo:503:mount.lustre.0 Request processed in 620us (6775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498629.977877:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789498629.977955:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0dfe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498629.977993:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885637888:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789498629.978888:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789498629.979009:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885638016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498629.979131:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498629.979197:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885638016 00000100:00100000:1.0:1789498629.979206:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885638016 00000100:00100000:1.0:1789498629.979263:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789498629.979273:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885638016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498629.979585:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885638016:12345-0@lo:502:mount.lustre.0 Request processed in 312us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498629.979593:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789498629.979653:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0dfe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498629.979687:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885638016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498629.988580:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789498629.988684:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789498629.988725:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789498629.988798:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789498629.988839:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789498629.990231:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789498629.990298:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789498629.990337:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789498629.990392:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789498629.990434:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789498629.990476:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789498629.990534:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789498629.990576:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789498629.990617:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789498629.990673:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789498629.990717:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789498629.999223:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789498629.999453:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789498629.999501:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789498629.999542:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789498629.999599:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789498629.999637:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789498629.999674:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789498629.999726:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789498629.999826:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789498630.001978:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789498630.002184:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789498630.002236:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789498630.002271:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789498630.002325:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789498630.002365:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789498630.002397:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789498630.002432:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789498630.002485:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789498630.002526:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789498630.002580:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789498630.002623:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789498630.002659:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789498630.002712:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789498630.002769:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789498630.002855:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885638144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498630.002968:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498630.003030:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e983fdd780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498630.003669:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885638144 00000100:00100000:1.0:1789498630.003681:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885638144 00000100:00100000:1.0:1789498630.003758:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789498630.003770:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885638144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498630.004172:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885638144:12345-0@lo:502:mount.lustre.0 Request processed in 403us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498630.004181:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789498630.004566:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885638144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498630.004722:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789498630.004741:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789498630.016425:0:15737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789498630.016452:0:15737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98ea83f2cd40) 00000020:00000080:3.0:1789498630.016485:0:15737:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789498630.016602:0:15737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98eabfb3d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789498630.016607:0:15737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98eabfb3d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789498630.016610:0:15737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eabfb3d800 3 00010000:00080000:3.0:1789498630.016651:0:15737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e9877b5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1789498630.019467:0:15737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789498630.021586:0:15737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789498630.021648:0:15737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789498630.021666:0:15737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3a6cb1946bc1946c 00000100:00080000:3.0:1789498630.021685:0:15737:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498630.021704:0:15737:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98e9877b5000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498630.021773:0:15737:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb4a6300 x1876424885638272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789498630.021845:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885638272:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789498630.021938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498630.024546:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885638272 00000100:00100000:0.0:1789498630.024569:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885638272 00000100:00100000:0.0:1789498630.024640:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498630.024651:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1876424885638272:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789498630.024691:0:14324:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1789498630.024761:0:14324:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3a6cb1946bc19473 00000004:00100000:0.0:1789498630.024785:0:14324:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789498630.024837:0:14324:0:(import.c:65:import_set_state_nolock()) ffff98ea891f7000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789498630.025121:0:15737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789498630.025210:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498630.025216:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498630.025220:0:38:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498630.025226:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1789498630.025232:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789498630.025243:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea82998800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498630.025271:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb4a5180 x1876424885638528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789498630.025673:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885638528:0@lo:8:kworker.0 00000100:00100000:2.0:1789498630.025736:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498630.025930:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876424885638272:12345-0@lo:38:llog_process_th.0 Request processed in 1278us (3990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498630.025939:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498630.030648:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885638400:0@lo:400:kworker.0 00000100:00100000:3.0:1789498630.030812:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498630.030880:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498630.030887:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885638656:0@lo:400:kworker.0 00000100:00100000:3.0:1789498630.030920:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498630.032891:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885638784:0@lo:400:kworker.0 00000100:00100000:3.0:1789498630.032991:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498630.033131:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885638528 00000100:00100000:3.0:1789498630.033145:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885638528 00000100:00100000:3.0:1789498630.033200:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885638400 00000100:00100000:3.0:1789498630.033204:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885638400 00000100:00100000:3.0:1789498630.033281:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498630.033293:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885638400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498630.033383:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885638400:12345-0@lo:400:kworker.0 Request processed in 92us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498630.033392:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498630.033414:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498630.033419:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876424885638528:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789498630.033474:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876424885638528:12345-0@lo:8:kworker.0 Request processed in 54us (7739us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789498630.033480:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498630.033511:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885638656 00000100:00100000:3.0:1789498630.033514:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885638656 00000100:00100000:3.0:1789498630.033534:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885638784 00000100:00100000:3.0:1789498630.033537:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885638784 00000100:00100000:3.0:1789498630.033553:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498630.033559:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885638656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498630.033595:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885638656:12345-0@lo:400:kworker.0 Request processed in 37us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498630.033622:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498630.033634:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498630.033639:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885638784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498630.033674:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885638784:12345-0@lo:400:kworker.0 Request processed in 35us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498630.033680:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789498630.033730:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb4a6680 x1876424885638784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498630.033768:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885638784:0@lo:400:kworker.0 00010000:00080000:3.0:1789498630.033818:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb4a6d80 x1876424885638656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498630.033829:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885638656:0@lo:400:kworker.0 00000100:00100000:3.0:1789498630.033845:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885638400:0@lo:400:kworker.0 00000040:00080000:3.0:1789498630.035494:0:15737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789498630.035666:0:15727:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789498630.035700:0:15727:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789498630.038799:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498630.038822:0:15727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789498630.038941:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789498630.038943:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789498630.038945:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498630.038951:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498630.038952:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498630.038954:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498630.038955:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498630.038957:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498630.038958:0:15727:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789498630.038963:0:15727:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789498630.038965:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789498630.038967:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789498630.038968:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498630.038969:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498630.038969:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498630.038970:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498630.038971:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498630.038972:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498630.038973:0:15727:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789498630.039015:0:15727:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789498630.039043:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885638912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789498630.039185:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498630.039256:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526840 going to sleep for 11 seconds 00010000:00080000:2.0:1789498630.039501:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb4a6300 x1876424885638272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498630.039517:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789498630.039529:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789498630.039540:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789498630.039547:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789498630.039551:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e9877b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789498630.039559:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885638272:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789498630.039599:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498630.039608:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498630.039651:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789498630.039657:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498630.039662:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789498630.039666:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885638528:0@lo:8:kworker.0 00000100:00100000:1.0:1789498630.039770:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885638912 00000100:00100000:1.0:1789498630.039782:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885638912 00000100:00100000:1.0:1789498630.039872:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789498630.039885:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:15727:x1876424885638912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789498630.039930:0:14318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789498630.039951:0:14318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789498630.130368:0:14318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789498630.130393:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789498630.130434:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789498630.130441:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789498630.130473:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498630.130498:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498630.130507:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498630.131915:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498630.131943:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 19 pid: 14315 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498630.131963:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1876424885639040:0@lo:104: 00000100:00100000:1.0:1789498630.132060:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498630.132160:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b3db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498630.133020:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885639040 00000100:00100000:0.0:1789498630.133036:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885639040 00000100:00100000:0.0:1789498630.133130:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498630.133143:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:14339:x1876424885639040:12345-0@lo:104: 00010000:00010000:0.0:1789498630.133164:0:14306:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.133273:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789498630.133281:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:14339:x1876424885639040:12345-0@lo:104: Request processed in 141us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498630.133310:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789498630.133339:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498630.133347:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.133356:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf800 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498630.133362:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.133373:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498630.133382:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498630.133388:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789498630.133435:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.133443:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498630.133470:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.133477:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc1934d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.133499:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498630.133501:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498630.133503:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498630.133521:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498630.133555:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885639168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498630.133602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498630.135597:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1876424885639040:0@lo:104: 00000100:00100000:0.0:1789498630.135821:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885639168 00000100:00100000:0.0:1789498630.135831:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885639168 00010000:00010000:0.0:1789498630.138006:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 20 pid: 14315 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498630.138082:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498630.138118:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+20:3305:x1876424885639168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498630.138143:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498630.138150:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 20 pid: 14315 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138167:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 20 pid: 14315 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138193:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91098a00/0x3a6cb1946bc1934d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19346 expref: 20 pid: 14315 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138218:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138232:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789498630.138258:0:14309:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007817614s 00010000:00010000:0.0:1789498630.138264:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138271:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138306:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138314:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138321:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498630.138326:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138338:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138348:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498630.138362:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498630.138487:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885639168:12345-0@lo:103:ldlm_bl.0 Request processed in 378us (4883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498630.138495:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498630.138560:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885639168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498630.138681:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498630.138694:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498630.138710:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498630.138717:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddf000/0x3a6cb1946bc1947a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498630.150353:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:15727:x1876424885638912:12345-0@lo:253:mount.lustre.0 Request processed in 110453us (111151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498630.150373:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789498630.151485:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1cf59db6-3bc5-4ded-8751-c46e361eaced:15727:1876424885638912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498630.151509:0:15727:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789498630.151513:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498630.151515:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789498630.151516:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498630.151517:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498630.151519:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498630.151520:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498630.151522:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498630.151525:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498630.151526:0:15727:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789498630.151606:0:15727:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789498630.157263:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498630.157458:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789498630.157658:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498630.157824:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789498630.157964:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789498630.158680:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789498630.159858:0:15727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789498630.284628:0:15727:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789498630.284643:0:15727:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789498630.284689:0:15727:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498630.284790:0:15727:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498630.284818:0:15727:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789498630.284917:0:15727:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789498630.571344:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789498631.211264:0:14320:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789498631.211275:0:14320:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98eaba3b0800 from 8 10000000:01000000:0.0:1789498631.211280:0:14320:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789498631.211355:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498631.211371:0:14320:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498631.211402:0:14320:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498631.211436:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885639296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498631.211544:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498631.211636:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e983fddd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789498631.211835:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885639296 00000100:00100000:2.0:1789498631.211845:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885639296 00000100:00100000:2.0:1789498631.211917:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789498631.211929:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:14320:x1876424885639296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498631.211947:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498631.211977:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6555c00/0x3a6cb1946bc19488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19481 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498631.212009:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6555c00/0x3a6cb1946bc19488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19481 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498631.212020:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6555c00/0x3a6cb1946bc19488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19481 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498631.212030:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6555c00, rc 0) 00000100:00100000:2.0:1789498631.212082:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:14320:x1876424885639296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498631.212140:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498631.212593:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885639296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498631.212625:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498631.212637:0:14320:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498631.212712:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885639424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789498631.212771:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498631.212808:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e983fddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789498631.212912:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885639424 00000100:00100000:3.0:1789498631.212918:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885639424 00000100:00100000:3.0:1789498631.212969:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789498631.212977:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:14320:x1876424885639424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789498631.212996:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789498631.213016:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789498631.213019:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789498631.213134:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:14320:x1876424885639424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498631.213142:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789498631.213385:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885639424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789498631.213455:0:14320:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789498631.213464:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498631.213474:0:14320:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498631.596481:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498631.671262:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498631.671283:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885639552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498631.671351:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498631.671534:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885639552 00000100:00100000:2.0:1789498631.671543:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885639552 00000100:00100000:2.0:1789498631.671594:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498631.671603:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885639552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498631.671641:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498631.671697:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885639552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498631.671705:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498631.671789:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885639552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498632.621673:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498633.644257:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498634.667381:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498635.247422:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498635.247429:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789498635.247433:0:38:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789498635.247544:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885639680:0@lo:400:kworker.0 00000100:00100000:3.0:1789498635.247616:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498635.247658:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885639808:0@lo:400:kworker.0 00000100:00100000:0.0:1789498635.247704:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789498635.247712:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea82998800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498635.247736:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabaa8fb80 x1876424885639936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498635.247746:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885639680 00000100:00100000:0.0:1789498635.247754:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885639680 00000100:00100000:2.0:1789498635.247798:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885640192:0@lo:400:kworker.0 00000100:00100000:0.0:1789498635.247798:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789498635.247838:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498635.247860:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498635.247885:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885639680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498635.247936:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885639680:12345-0@lo:400:kworker.0 Request processed in 54us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498635.247943:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789498635.248020:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885639808 00000100:00100000:3.0:1789498635.248024:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885639808 00000100:00100000:3.0:1789498635.248070:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498635.248078:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885639808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498635.248559:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885639808:12345-0@lo:400:kworker.0 Request processed in 481us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498635.248567:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498635.248626:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885640320:0@lo:400:kworker.0 00000100:00080000:0.0:1789498635.248776:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498635.248847:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498635.249036:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885640064:0@lo:400:kworker.0 00000100:00100000:2.0:1789498635.249066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498635.249348:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885639936:0@lo:8:kworker.0 00000100:00100000:2.0:1789498635.249376:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498635.249404:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885640192 00000100:00100000:0.0:1789498635.249412:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885640192 00000100:00100000:2.0:1789498635.249437:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885639680:0@lo:400:kworker.0 00000100:00100000:0.0:1789498635.249451:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885640320 00000100:00100000:0.0:1789498635.249454:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885640320 00000100:00100000:0.0:1789498635.249466:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885640064 00000100:00100000:0.0:1789498635.249469:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885640064 00000100:00100000:0.0:1789498635.249483:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498635.249490:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885640192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498635.249540:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885640192:12345-0@lo:400:kworker.0 Request processed in 50us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498635.249547:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498635.249560:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789498635.249566:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885640320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498635.249567:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498635.249574:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885640064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498635.249594:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885640320:12345-0@lo:400:kworker.0 Request processed in 29us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498635.249601:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789498635.249602:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885640064:12345-0@lo:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498635.249608:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789498635.249615:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498635.249624:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885639936 00000100:00100000:2.0:1789498635.249628:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885639936 00000100:00100000:2.0:1789498635.249661:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498635.249666:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885639936:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789498635.249693:0:15006:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:2.0:1789498635.249723:0:15006:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc1948f 00002000:00100000:2.0:1789498635.249737:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98ea894ff000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789498635.249741:0:15006:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789498635.249744:0:15006:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789498635.250238:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789498635.250267:0:15006:0:(import.c:65:import_set_state_nolock()) ffff98ea894f9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498635.250315:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876424885639936:12345-0@lo:8:kworker.0 Request processed in 648us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498635.250323:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789498635.250713:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8e680 x1876424885640320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498635.250727:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885640320:0@lo:400:kworker.0 00010000:00080000:2.0:1789498635.250739:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8f100 x1876424885640192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498635.250765:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885640192:0@lo:400:kworker.0 00010000:00080000:2.0:1789498635.250807:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8ca80 x1876424885640064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498635.250817:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885640064:0@lo:400:kworker.0 00010000:00080000:2.0:1789498635.250842:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabaa8fb80 x1876424885639936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789498635.250854:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789498635.250861:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789498635.250867:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789498635.250869:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789498635.250885:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789498635.250890:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885639936:0@lo:8:kworker.0 00000100:00100000:2.0:1789498635.250918:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885639808:0@lo:400:kworker.0 00000004:00080000:0.0:1789498635.250957:0:14348:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789498635.250977:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1876424885640576:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789498635.251020:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498635.251029:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498635.251037:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885640448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498635.251042:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e983fdd600 going to sleep for 11 seconds 00000004:00080000:0.0:1789498635.251056:0:14347:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789498635.251060:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498635.251084:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885640448 00000100:00100000:2.0:1789498635.251107:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885640448 00000100:00100000:2.0:1789498635.251279:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498635.251286:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885640448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498635.251312:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498635.251349:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885640448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498635.251364:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789498635.251390:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eaba23a300 x1876424885640448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498635.251404:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885640448:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789498635.252326:0:14347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 535016233760ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789498635.252370:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885640576 00000100:00100000:0.0:1789498635.252377:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885640576 00000100:00100000:0.0:1789498635.252409:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498635.252417:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14348:x1876424885640576:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1789498635.256309:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789498635.280076:0:15007:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789498635.280521:0:15007:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789498635.280529:0:15007:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1789498635.297551:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498635.297571:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.297596:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789498635.297602:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498635.297609:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.297634:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.297662:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.297673:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.297718:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.298672:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.298689:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.299040:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.299046:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.299060:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.299245:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.299256:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19496 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.299282:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.299284:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.299286:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498635.300391:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498635.300413:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300433:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789498635.300439:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498635.300447:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300465:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300476:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300484:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300535:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498635.300552:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498635.300560:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300569:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498635.300586:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300596:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300615:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300623:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc1949d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.300647:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.300659:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.300661:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498635.304972:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498635.304993:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.305016:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789498635.305022:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498635.305030:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.305049:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.305063:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.305080:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789498635.317595:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789498635.317735:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498635.317756:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498635.317766:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.317784:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498635.317791:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.317805:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.317830:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.317839:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.317862:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.317864:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.317866:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498635.319476:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498635.319492:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.319511:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789498635.319518:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498635.319526:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.319542:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.319552:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.319560:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.319579:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789498635.320073:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498635.320081:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.320139:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789498635.320142:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498635.320147:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.320172:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.320181:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.320189:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.320209:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789498635.320421:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498635.320430:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320440:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.320445:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320457:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320483:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320490:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd210d6/0x3a6cb1946bc194ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320513:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.320517:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320524:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.320527:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320535:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320544:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320552:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e191c642/0x3a6cb1946bc194b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.320563:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.320564:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.320573:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.323376:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498635.332725:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498635.332748:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332772:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789498635.332778:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498635.332787:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332808:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332836:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332858:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332886:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498635.332906:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498635.332914:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332922:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498635.332929:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332941:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332961:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332969:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc194b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.332993:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.332995:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.332997:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.337893:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.337909:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.337926:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.337931:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.337938:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.337953:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.337962:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.337967:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.337987:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498635.338001:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498635.338006:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.338011:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498635.338014:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.338029:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.338042:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.338047:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.338060:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.338061:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.338062:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.339319:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.339330:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.339345:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.339350:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.339355:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.339367:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.339374:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.339387:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.339403:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.339451:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.339460:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.339470:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.339475:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.339484:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.339496:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.339501:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efb8de8a/0x3a6cb1946bc194c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.339515:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.339516:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.339517:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.340607:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.340614:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340624:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.340626:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.340630:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340640:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340658:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340666:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340683:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498635.340695:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498635.340701:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340716:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfe00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498635.340719:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340726:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340737:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.340742:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004053e3c2/0x3a6cb1946bc194ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.341200:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.341203:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.341205:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.347011:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.347024:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347043:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.347051:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.347058:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347074:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347128:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347137:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347160:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498635.347176:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498635.347183:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347191:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfa00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498635.347196:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347205:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347224:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347232:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc61e94/0x3a6cb1946bc194d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.347256:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.347264:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.347267:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.348890:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.348903:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.348920:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.348925:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.348932:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.348948:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.348957:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.348963:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.349039:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498635.349400:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.349405:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.349411:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.349414:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.349417:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.349429:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.349435:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.349455:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498635.349464:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.349485:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddec00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498635.349489:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.349499:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.349521:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.349529:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d26537e3/0x3a6cb1946bc194dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.349549:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498635.349552:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498635.349554:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789498635.349815:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789498635.350559:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.350577:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.350704:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.350712:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.350723:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.350728:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.350752:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.350769:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.350777:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bcbc07c/0x3a6cb1946bc194e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.350914:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.350917:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.350920:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.351140:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.351148:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351159:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.351163:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.351168:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351180:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351189:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351202:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351215:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.351262:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.351269:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.351278:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.351282:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.351292:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.351307:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.351326:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000271ab595/0x3a6cb1946bc194ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.351349:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.351352:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.351355:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.351825:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.351832:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351840:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.351842:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.351845:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351851:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351856:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351860:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.351878:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.352204:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.352209:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.352216:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.352218:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.352224:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.352233:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.352238:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a76beb5e/0x3a6cb1946bc194f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.352248:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.352249:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.352250:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.352685:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.352693:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.352711:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.352715:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.352719:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.352726:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.352732:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.352737:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.352754:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.353522:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.353528:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.353536:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddea00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.353539:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.353545:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.353557:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.353562:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452d4226/0x3a6cb1946bc194f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.353577:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.353578:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.353579:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.354307:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.354316:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.354328:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.354332:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.354336:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.354345:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.354359:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.354364:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.354378:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.354522:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.354527:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.354533:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.354536:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.354551:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.354561:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.354566:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc194ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.354578:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.354580:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.354581:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.355003:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.355020:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.355026:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.355029:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.355032:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.355039:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.355044:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.355049:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.355073:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.355333:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.355339:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.355346:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.355349:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.355357:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.355369:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.355387:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f68b583/0x3a6cb1946bc19506 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.355403:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.355405:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.355407:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.355987:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.355996:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356006:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.356009:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.356013:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356023:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356031:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356038:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356129:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498635.356811:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.356820:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356831:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.356841:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.356845:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356855:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356864:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.356872:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.356954:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498635.356962:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.356970:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.356975:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.356985:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.357001:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.357010:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc1950d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.357029:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.357032:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.357046:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.357049:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.357058:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.357068:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.357076:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.357078:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.357080:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.357232:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789498635.357238:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bb3c1c5/0x3a6cb1946bc19514 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498635.357768:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.357775:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.357786:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.357790:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.357794:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.357804:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.357820:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.357827:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.357888:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498635.357923:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789498635.357933:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.358380:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.358386:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.358395:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.358399:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.358403:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.358412:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.358421:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.358429:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.358583:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498635.358683:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1789498635.358979:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.358985:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.358994:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.358997:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.359001:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.359010:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.359014:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498635.359019:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.359021:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.359022:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.359032:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.359052:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498635.359065:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359077:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498635.359082:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359115:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359202:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359212:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19522 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359232:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498635.359236:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359244:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498635.359248:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359256:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359283:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359291:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b809314a/0x3a6cb1946bc19529 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359311:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.359313:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.359316:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.359619:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.359625:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.359633:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.359640:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.359644:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.359665:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.359674:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.359681:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.359698:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498635.359747:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498635.359756:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.359766:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498635.359770:0:15943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.359778:0:15943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.359792:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498635.359797:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498635.359803:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f804839/0x3a6cb1946bc19530 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.359821:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498635.359824:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498635.359826:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.360055:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.360061:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360068:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.360071:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.360075:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360084:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360175:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360190:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360207:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498635.360530:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360542:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.360546:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360555:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360568:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360583:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050beb474/0x3a6cb1946bc1951b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360599:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.360602:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360609:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.360612:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360620:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360629:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360636:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f9930a7/0x3a6cb1946bc19537 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.360645:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.360657:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.360659:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.360824:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.360829:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360838:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.360842:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.360846:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360855:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360863:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360871:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.360920:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498635.361357:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.361362:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.361376:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.361378:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.361383:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.361391:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.361400:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.361407:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361562:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498635.361568:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361583:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.361587:0:15943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361596:0:15943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361608:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361615:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009011aac6/0x3a6cb1946bc1953e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361630:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498635.361633:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361639:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498635.361642:0:15943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361661:0:15943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361670:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498635.361685:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.361686:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498635.361688:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498635.363103:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789498635.363118:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b96306e/0x3a6cb1946bc19545 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.363130:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498635.363282:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498635.365222:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498635.365239:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.365261:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789498635.365266:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498635.365273:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.365302:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.365315:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.365324:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498635.365352:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789498635.365590:0:15007:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:2.0:1789498635.365666:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498635.365675:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.365765:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498635.365770:0:15943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.365780:0:15943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.365799:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.365807:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000919aae4/0x3a6cb1946bc1954c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498635.365828:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498635.365830:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498635.365832:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498635.366315:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14348:x1876424885640576:12345-0@lo:5:osp-pre-1-0.0 Request processed in 113892us (115287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498635.366327:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498635.366424:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1876424885640576:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789498635.366445:0:14348:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789498635.366499:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1876424885640704:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789498635.366547:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498635.366640:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e983fdd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498635.366687:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885640704 00000100:00100000:1.0:1789498635.366696:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885640704 00000100:00100000:1.0:1789498635.366821:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498635.366832:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14348:x1876424885640704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789498635.367409:0:15008:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1789498635.377794:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14348:x1876424885640704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10956us (11238us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789498635.377811:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498635.378012:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1876424885640704:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789498635.378029:0:14348:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1789498635.691577:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498636.715216:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498636.779250:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498636.779277:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885640832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498636.779353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498636.779606:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885640832 00000100:00100000:2.0:1789498636.779614:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885640832 00000100:00100000:2.0:1789498636.779678:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498636.779687:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885640832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498636.779728:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498636.779784:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885640832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498636.779792:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498636.779839:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885640832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498637.741022:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789498638.091132:0:16084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1789498638.188384:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789498638.775057:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498639.791657:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498640.375652:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885640960:0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.375730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498640.375778:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885641472:0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.375805:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498640.375829:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789498640.375834:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885641088:0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.375854:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498640.375872:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885641600:0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.375889:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498640.375912:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885641216:0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.375930:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498640.375945:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498640.375948:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885641344:0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.375964:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498640.375997:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885640960 00000100:00100000:2.0:1789498640.376005:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885640960 00000100:00100000:2.0:1789498640.376049:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789498640.376057:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885640960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.376247:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885640960:12345-0@lo:400:kworker.0 Request processed in 71us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.376336:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789498640.376373:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885641472 00000100:00100000:2.0:1789498640.376377:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885641472 00000100:00100000:2.0:1789498640.376404:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885641600 00000100:00100000:2.0:1789498640.376407:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885641600 00000100:00100000:2.0:1789498640.376420:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885641344 00000100:00100000:2.0:1789498640.376422:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885641344 00000100:00100000:2.0:1789498640.376434:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498640.376439:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885641472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.376473:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885641472:12345-0@lo:400:kworker.0 Request processed in 34us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.376479:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498640.376490:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498640.376496:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885641600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.376522:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885641600:12345-0@lo:400:kworker.0 Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.376529:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789498640.377555:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885641088 00000100:00100000:0.0:1789498640.377572:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885641088 00000100:00100000:0.0:1789498640.377613:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885641216 00000100:00100000:0.0:1789498640.377616:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885641216 00000100:00100000:0.0:1789498640.377651:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498640.377658:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885641088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498640.377716:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885641088:12345-0@lo:400:kworker.0 Request processed in 58us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498640.377723:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498640.377739:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498640.377744:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885641216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498640.377773:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885641216:12345-0@lo:400:kworker.0 Request processed in 29us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498640.377779:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498640.378232:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498640.378240:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885641344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.378807:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885641344:12345-0@lo:400:kworker.0 Request processed in 566us (2839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.378816:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498640.378893:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885641088:0@lo:400:kworker.0 00010000:00080000:2.0:1789498640.378911:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fff800 x1876424885641600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498640.378921:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885641600:0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.378947:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885640960:0@lo:400:kworker.0 00010000:00080000:2.0:1789498640.378958:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9ffce00 x1876424885641472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498640.378966:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885641472:0@lo:400:kworker.0 00000100:00080000:2.0:1789498640.379008:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498640.379013:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498640.379016:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498640.379031:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885641728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498640.379068:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789498640.383607:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9ffd880 x1876424885641344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498640.383628:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885641344:0@lo:400:kworker.0 00000100:00100000:2.0:1789498640.383664:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885641216:0@lo:400:kworker.0 00000100:00100000:0.0:1789498640.384410:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885641728 00000100:00100000:0.0:1789498640.384419:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885641728 00000100:00100000:0.0:1789498640.384463:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789498640.384472:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885641728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498640.384509:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498640.384611:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885641728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (5541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498640.384618:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498640.385715:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885641728:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789498640.521339:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1789498640.596605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498640.596691:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864670592 00000100:00100000:0.0:1789498640.596704:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864670592 00000100:00100000:0.0:1789498640.596760:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:0.0:1789498640.596769:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2354:x1876424864670592:12345-192.168.201.20@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789498640.596805:0:14318:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7e869000-0a12-4277-a881-2610e585c112@192.168.201.20@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1789498640.596840:0:14318:0:(genops.c:1384:class_connect()) connect: client 7e869000-0a12-4277-a881-2610e585c112, cookie 0x3a6cb1946bc19553 00000100:00080000:0.0:1789498640.597031:0:14318:0:(import.c:65:import_set_state_nolock()) ffff98ea891f1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498640.597151:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+5:2354:x1876424864670592:12345-192.168.201.20@tcp:250:mount.lustre.0 Request processed in 382us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498640.597175:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:3.0:1789498640.622788:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498640.623477:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864670720 00000100:00100000:2.0:1789498640.623491:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864670720 00000100:00100000:2.0:1789498640.623563:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:2.0:1789498640.623575:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+5:13731:x1876424864670720:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498640.623598:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498640.623623:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6555a00/0x3a6cb1946bc1955a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a3b8 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.623664:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6555a00/0x3a6cb1946bc1955a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3b8 expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.623703:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6555a00/0x3a6cb1946bc1955a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3b8 expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.623714:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6555a00, rc 0) 00000100:00100000:2.0:1789498640.624263:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+6:13731:x1876424864670720:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 688us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.624279:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:3.0:1789498640.640368:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498640.640460:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864670848 00000100:00100000:1.0:1789498640.640487:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864670848 00000100:00100000:1.0:1789498640.640562:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1789498640.640573:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+6:13731:x1876424864670848:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789498640.640909:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+6:13731:x1876424864670848:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 338us (550us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789498640.640918:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:0.0:1789498640.656815:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498640.656924:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864670976 00000100:00100000:2.0:1789498640.656934:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864670976 00000100:00100000:2.0:1789498640.656991:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:2.0:1789498640.657002:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+6:13731:x1876424864670976:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498640.657023:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498640.657043:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554e00/0x3a6cb1946bc19561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a3bf expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.657075:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554e00/0x3a6cb1946bc19561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3bf expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.657087:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554e00/0x3a6cb1946bc19561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3bf expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.657131:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554e00, rc 0) 00000100:00100000:2.0:1789498640.657197:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+7:13731:x1876424864670976:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 197us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.657204:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1789498640.659894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498640.662194:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864671104 00000100:00100000:0.0:1789498640.662210:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864671104 00000100:00100000:0.0:1789498640.662296:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:0.0:1789498640.662307:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+7:13731:x1876424864671104:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789498640.662643:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+8:13731:x1876424864671104:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 336us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498640.662651:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:3.0:1789498640.671254:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498640.671420:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864671232 00000100:00100000:1.0:1789498640.671431:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864671232 00000100:00100000:1.0:1789498640.671492:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1789498640.671502:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+8:13731:x1876424864671232:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789498640.671896:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+8:13731:x1876424864671232:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 394us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498640.671903:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1789498640.706761:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498640.707021:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864671360 00000100:00100000:2.0:1789498640.707050:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864671360 00000100:00100000:2.0:1789498640.707137:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:2.0:1789498640.707147:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+8:13750:x1876424864671360:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498640.707512:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+8:13750:x1876424864671360:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 366us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.707520:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:3.0:1789498640.749244:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498640.749592:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864671488 00000100:00100000:0.0:1789498640.749603:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864671488 00000100:00100000:0.0:1789498640.749669:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:0.0:1789498640.749680:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+8:13750:x1876424864671488:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498640.750283:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+8:13750:x1876424864671488:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 603us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498640.750293:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:3.0:1789498640.773016:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498640.773460:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864671616 00000100:00100000:1.0:1789498640.773471:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864671616 00000100:00100000:1.0:1789498640.773532:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:1.0:1789498640.773543:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+8:13731:x1876424864671616:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789498640.773569:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498640.773589:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a3e9 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498640.773620:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3e9 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498640.773632:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3e9 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498640.773663:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01600, rc 0) 00000100:00100000:1.0:1789498640.773733:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+9:13731:x1876424864671616:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 192us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498640.773740:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:1.0:1789498640.779067:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498640.779271:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864671744 00000100:00100000:0.0:1789498640.779283:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864671744 00000100:00100000:0.0:1789498640.779341:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:0.0:1789498640.779352:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+9:13731:x1876424864671744:12345-192.168.201.20@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789498640.779382:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789498640.779415:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789498640.779431:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789498640.779435:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789498640.779438:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789498640.780814:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+9:13731:x1876424864671744:12345-192.168.201.20@tcp:256:mount.lustre.0 Request processed in 1456us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498640.780828:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:3.0:1789498640.782971:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498640.783147:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864671872 00000100:00100000:2.0:1789498640.783159:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864671872 00000100:00100000:2.0:1789498640.783212:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:2.0:1789498640.783221:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+9:13731:x1876424864671872:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498640.783236:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498640.783252:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a3f0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.783280:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.783292:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498640.783300:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554c00, rc 0) 00000100:00100000:2.0:1789498640.783348:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+10:13731:x1876424864671872:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 129us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.783355:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:2.0:1789498640.799813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498640.800165:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864672000 00000100:00100000:1.0:1789498640.800177:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864672000 00000100:00100000:1.0:1789498640.800234:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:1.0:1789498640.800245:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+10:13731:x1876424864672000:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789498640.800573:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+10:13731:x1876424864672000:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 328us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498640.800581:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:3.0:1789498640.807070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498640.808175:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864672128 00000100:00100000:0.0:1789498640.808188:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864672128 00000100:00100000:0.0:1789498640.808248:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:0.0:1789498640.808259:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+10:13731:x1876424864672128:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789498640.808785:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+10:13731:x1876424864672128:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 526us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498640.808793:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00010000:00010000:3.0:1789498640.812880:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498640.822762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498640.822856:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864672256 00000100:00100000:2.0:1789498640.822871:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864672256 00000100:00100000:2.0:1789498640.822943:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1789498640.822953:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+10:13755:x1876424864672256:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498640.823300:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+10:13755:x1876424864672256:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 347us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.823308:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1789498640.838906:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498640.839001:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864672384 00000100:00100000:1.0:1789498640.839012:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864672384 00000100:00100000:1.0:1789498640.839076:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:1.0:1789498640.839086:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+10:13755:x1876424864672384:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498640.839397:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+10:13755:x1876424864672384:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 311us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498640.839406:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:3.0:1789498640.855264:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498640.855639:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864672512 00000100:00100000:2.0:1789498640.855650:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864672512 00000100:00100000:2.0:1789498640.855708:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1789498640.855717:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1876424864672512:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789498640.855747:0:14324:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 68cd9685-a43a-48ba-9cd1-2238ca644a97@192.168.201.20@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:2.0:1789498640.855793:0:14324:0:(genops.c:1384:class_connect()) connect: client 68cd9685-a43a-48ba-9cd1-2238ca644a97, cookie 0x3a6cb1946bc19576 00000004:00100000:2.0:1789498640.855828:0:14324:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789498640.855834:0:14324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789498640.958593:0:14324:0:(import.c:65:import_set_state_nolock()) ffff98e9877b1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498640.958679:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2354:x1876424864672512:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 102959us (103425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498640.958690:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498640.962955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498640.962998:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498640.963155:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864672640 00000100:00100000:2.0:1789498640.963166:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864672640 00000100:00100000:2.0:1789498640.963245:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864672768 00000100:00100000:2.0:1789498640.963249:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864672768 00000100:00100000:2.0:1789498640.963266:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:2.0:1789498640.963275:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:0:x1876424864672640:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789498640.963326:0:14323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789498640.963413:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:0:x1876424864672640:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 139us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.963421:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:2.0:1789498640.963438:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1789498640.963445:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13731:x1876424864672768:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789498640.963471:0:14323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789498640.963494:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13731:x1876424864672768:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 50us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498640.963500:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00080000:3.0:1789498640.963666:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498640.968434:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498640.968571:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864672896 00000100:00100000:3.0:1789498640.968582:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864672896 00000100:00100000:3.0:1789498640.968695:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:3.0:1789498640.968706:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13731:x1876424864672896:12345-192.168.201.20@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789498640.968829:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13731:x1876424864672896:12345-192.168.201.20@tcp:40:mount.lustre.0 Request processed in 125us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498640.968837:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:3.0:1789498640.971223:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498640.971309:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498640.971343:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498640.971435:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864673024 00000100:00100000:1.0:1789498640.971444:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864673024 00000100:00100000:1.0:1789498640.971483:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864673152 00000100:00100000:1.0:1789498640.971487:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864673152 00000100:00100000:1.0:1789498640.971503:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1789498640.971510:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1876424864673024:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789498640.971576:0:15006:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 68cd9685-a43a-48ba-9cd1-2238ca644a97@192.168.201.20@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1789498640.971614:0:15006:0:(genops.c:1384:class_connect()) connect: client 68cd9685-a43a-48ba-9cd1-2238ca644a97, cookie 0x3a6cb1946bc1957d 00002000:00100000:1.0:1789498640.971626:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68cd9685-a43a-48ba-9cd1-2238ca644a97/ffff98e987724800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789498640.971656:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789498640.972050:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789498640.972082:0:15006:0:(import.c:65:import_set_state_nolock()) ffff98e987724000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498640.972196:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2354:x1876424864673024:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 685us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498640.972205:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1789498640.972225:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:1.0:1789498640.972230:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1876424864673152:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789498640.972247:0:15006:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 68cd9685-a43a-48ba-9cd1-2238ca644a97@192.168.201.20@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1789498640.972265:0:15006:0:(genops.c:1384:class_connect()) connect: client 68cd9685-a43a-48ba-9cd1-2238ca644a97, cookie 0x3a6cb1946bc19584 00002000:00100000:1.0:1789498640.972271:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68cd9685-a43a-48ba-9cd1-2238ca644a97/ffff98e987721800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789498640.972277:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789498640.972491:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789498640.972508:0:15006:0:(import.c:65:import_set_state_nolock()) ffff98e987727800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498640.972533:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2354:x1876424864673152:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 301us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498640.972540:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498640.977903:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864673280 00000100:00100000:2.0:1789498640.977921:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864673280 00000100:00100000:2.0:1789498640.977986:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1789498640.977997:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13731:x1876424864673280:12345-192.168.201.20@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789498640.980182:0:14326:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2097us 00000004:00200000:0.0:1789498641.017795:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789498641.017939:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13731:x1876424864673280:12345-192.168.201.20@tcp:33:mount.lustre.0 Request processed in 39938us (46716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498641.017953:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:3.0:1789498641.328910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498641.329018:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864673408 00000100:00100000:0.0:1789498641.329029:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864673408 00000100:00100000:0.0:1789498641.329140:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:0.0:1789498641.329152:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13776:x1876424864673408:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:0.0:1789498641.329174:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498641.329199:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1958b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a41a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498641.329279:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19592 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498641.329294:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498641.329332:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498641.329375:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498641.329379:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498641.329425:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498641.329450:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1958b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a41a expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498641.329468:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a41a expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498641.329476:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf800) 00010000:00010000:0.0:1789498641.329479:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498641.329483:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5000, rc 0) 00000100:00100000:0.0:1789498641.329782:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:13776:x1876424864673408:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 631us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498641.329791:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00010000:00010000:0.0:1789498641.835400:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498641.899441:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885641856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498641.899558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498641.899819:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885641856 00000100:00100000:2.0:1789498641.899829:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885641856 00000100:00100000:2.0:1789498641.899888:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498641.899899:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885641856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498641.899925:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498641.899992:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885641856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498641.900000:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789498641.900412:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885641856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498642.863891:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789498642.975688:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68cd9685-a43a-48ba-9cd1-2238ca644a97 00000100:00100000:0.0:1789498643.416956:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498643.417072:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864673536 00000100:00100000:3.0:1789498643.417082:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864673536 00000100:00100000:3.0:1789498643.417169:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:3.0:1789498643.417180:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:13828:x1876424864673536:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1789498643.417229:0:14323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789498643.417327:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:13828:x1876424864673536:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 150us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498643.417335:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00080000:2.0:1789498643.417859:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498643.427787:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498643.428528:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864673664 00000100:00100000:2.0:1789498643.428540:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864673664 00000100:00100000:2.0:1789498643.428669:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:2.0:1789498643.428681:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:13828:x1876424864673664:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1789498643.428731:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498643.428850:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:13828:x1876424864673664:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 171us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.428880:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00080000:3.0:1789498643.429554:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498643.432880:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498643.433395:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864673792 00000100:00100000:2.0:1789498643.433407:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864673792 00000100:00100000:2.0:1789498643.433540:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498643.433550:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13828:x1876424864673792:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1789498643.433594:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498643.433685:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:13828:x1876424864673792:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 137us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.433692:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00080000:3.0:1789498643.434500:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498643.701707:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498643.704701:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864673920 00000100:00100000:3.0:1789498643.704734:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864673920 00000100:00100000:3.0:1789498643.704855:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:3.0:1789498643.704870:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+10:13862:x1876424864673920:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789498643.704896:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498643.704925:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad90400/0x3a6cb1946bc19599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a421 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498643.704974:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad90400/0x3a6cb1946bc19599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a421 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498643.705036:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad90400/0x3a6cb1946bc19599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a421 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498643.705048:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90400, rc 0) 00000100:00100000:3.0:1789498643.705607:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+11:13862:x1876424864673920:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 736us (3913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498643.705619:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:0.0:1789498643.723265:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498643.723402:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864674048 00000100:00100000:2.0:1789498643.723417:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864674048 00000100:00100000:2.0:1789498643.723495:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:2.0:1789498643.723519:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+11:13862:x1876424864674048:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789498643.723954:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+11:13862:x1876424864674048:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 436us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.723964:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:0.0:1789498643.730578:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.731472:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864674176 00000100:00100000:1.0:1789498643.731491:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864674176 00000100:00100000:1.0:1789498643.731620:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:1.0:1789498643.731634:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+11:13862:x1876424864674176:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789498643.733370:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+11:13862:x1876424864674176:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 1719us (6652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498643.733389:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:0.0:1789498643.740402:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498643.741367:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864674304 00000100:00100000:3.0:1789498643.741386:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864674304 00000100:00100000:3.0:1789498643.741468:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:3.0:1789498643.741480:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+11:13868:x1876424864674304:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789498643.742397:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+11:13868:x1876424864674304:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 910us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498643.742410:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:0.0:1789498643.768406:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.768614:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864674432 00000100:00100000:1.0:1789498643.768628:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864674432 00000100:00100000:1.0:1789498643.768769:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:1.0:1789498643.768782:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+11:13868:x1876424864674432:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498643.769251:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+11:13868:x1876424864674432:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 470us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498643.769271:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:0.0:1789498643.774035:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498643.774565:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864674560 00000100:00100000:3.0:1789498643.774580:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864674560 00000100:00100000:3.0:1789498643.774658:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:3.0:1789498643.774671:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+11:13862:x1876424864674560:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789498643.774696:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498643.774734:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad91000/0x3a6cb1946bc195a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a44b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498643.774777:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad91000/0x3a6cb1946bc195a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a44b expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498643.774790:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad91000/0x3a6cb1946bc195a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a44b expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498643.774824:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91000, rc 0) 00000100:00100000:3.0:1789498643.774913:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+12:13862:x1876424864674560:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 245us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498643.774921:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:0.0:1789498643.780412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498643.780863:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864674688 00000100:00100000:3.0:1789498643.780879:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864674688 00000100:00100000:3.0:1789498643.780959:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:3.0:1789498643.780972:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+12:13862:x1876424864674688:12345-192.168.201.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789498643.781024:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789498643.781059:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789498643.781065:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789498643.781081:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789498643.781084:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789498643.783609:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+12:13862:x1876424864674688:12345-192.168.201.20@tcp:256:mount.lustre.0 Request processed in 2623us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498643.783629:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:0.0:1789498643.786915:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.792458:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864674816 00000100:00100000:1.0:1789498643.792482:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864674816 00000100:00100000:1.0:1789498643.792621:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:1.0:1789498643.792635:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+12:13862:x1876424864674816:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789498643.792662:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498643.792688:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a452 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498643.792728:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498643.792742:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498643.792754:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00800, rc 0) 00000100:00100000:1.0:1789498643.792868:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:13862:x1876424864674816:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 235us (5969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498643.792875:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:0.0:1789498643.800439:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498643.800615:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864674944 00000100:00100000:3.0:1789498643.800630:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864674944 00000100:00100000:3.0:1789498643.800705:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:3.0:1789498643.800717:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:13862:x1876424864674944:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789498643.801208:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:13862:x1876424864674944:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 491us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498643.801218:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:3.0:1789498643.804687:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498643.807867:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864675072 00000100:00100000:0.0:1789498643.807891:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864675072 00000100:00100000:0.0:1789498643.809595:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:0.0:1789498643.809625:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:13862:x1876424864675072:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789498643.809978:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:13862:x1876424864675072:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 367us (5304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498643.809987:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:3.0:1789498643.814850:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.815009:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864675200 00000100:00100000:1.0:1789498643.815023:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864675200 00000100:00100000:1.0:1789498643.815143:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:1.0:1789498643.815156:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:13874:x1876424864675200:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498643.815573:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:13874:x1876424864675200:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 417us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.815584:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:1.0:1789498643.834256:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498643.834389:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864675328 00000100:00100000:2.0:1789498643.834404:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864675328 00000100:00100000:2.0:1789498643.834527:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:2.0:1789498643.834539:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:13874:x1876424864675328:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498643.834916:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:13874:x1876424864675328:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 377us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.834933:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:1.0:1789498643.860218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.860275:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.860312:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.860341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498643.860464:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864675968 00000100:00100000:2.0:1789498643.860479:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864675968 00000100:00100000:2.0:1789498643.860567:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864676096 00000100:00100000:2.0:1789498643.860570:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864676096 00000100:00100000:2.0:1789498643.860605:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1789498643.860616:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864675968:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498643.860714:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864675968:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 100us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.860723:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1789498643.860744:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:2.0:1789498643.860750:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864676096:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498643.860779:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864676096:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.860786:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1789498643.860963:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864675456 00000100:00100000:0.0:1789498643.860969:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864675456 00000100:00100000:0.0:1789498643.861015:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864675840 00000100:00100000:0.0:1789498643.861019:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864675840 00000100:00100000:0.0:1789498643.861044:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498643.861052:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2355:x1876424864675840:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498643.861085:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2355:x1876424864675840:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498643.861127:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498643.861144:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1789498643.861149:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1876424864675456:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789498643.861208:0:14325:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a@192.168.201.20@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1789498643.861265:0:14325:0:(genops.c:1384:class_connect()) connect: client b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a, cookie 0x3a6cb1946bc195ae 00000004:00100000:0.0:1789498643.861314:0:14325:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789498643.861481:0:14325:0:(import.c:65:import_set_state_nolock()) ffff98ea891f2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498643.861532:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2354:x1876424864675456:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 380us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498643.861540:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1789498643.881197:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498643.881236:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498643.881380:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864675584 00000100:00100000:2.0:1789498643.881395:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864675584 00000100:00100000:2.0:1789498643.881492:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864675712 00000100:00100000:2.0:1789498643.881503:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864675712 00000100:00100000:2.0:1789498643.881533:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498643.881546:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+7:0:x1876424864675584:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789498643.881598:0:14325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1789498643.884313:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498643.884574:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+7:0:x1876424864675584:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 3017us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.884599:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498643.884688:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:2.0:1789498643.884704:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:13862:x1876424864675712:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789498643.884746:0:14325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789498643.884827:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:13862:x1876424864675712:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 132us (3590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.884832:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00010000:00010000:3.0:1789498643.884948:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498643.892221:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498643.892548:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864676224 00000100:00100000:2.0:1789498643.892565:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864676224 00000100:00100000:2.0:1789498643.892662:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1789498643.892677:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:13862:x1876424864676224:12345-192.168.201.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789498643.892810:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:13862:x1876424864676224:12345-192.168.201.20@tcp:40:mount.lustre.0 Request processed in 136us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498643.892818:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:1.0:1789498643.905411:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.905462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498643.905510:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498643.905627:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864676352 00000100:00100000:0.0:1789498643.905641:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864676352 00000100:00100000:0.0:1789498643.905699:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864676480 00000100:00100000:0.0:1789498643.905702:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864676480 00000100:00100000:0.0:1789498643.905721:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:0.0:1789498643.905734:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876424864676352:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789498643.905779:0:15007:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a@192.168.201.20@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1789498643.905842:0:15007:0:(genops.c:1384:class_connect()) connect: client b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a, cookie 0x3a6cb1946bc195b5 00002000:00100000:0.0:1789498643.905857:0:15007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a/ffff98ea891f0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789498643.905873:0:15007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789498643.906273:0:15007:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789498643.906315:0:15007:0:(import.c:65:import_set_state_nolock()) ffff98ea891f6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498643.906408:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2354:x1876424864676352:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 676us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498643.906417:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:0.0:1789498643.906445:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:0.0:1789498643.906472:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876424864676480:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789498643.906505:0:15007:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a@192.168.201.20@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1789498643.906531:0:15007:0:(genops.c:1384:class_connect()) connect: client b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a, cookie 0x3a6cb1946bc195bc 00002000:00100000:0.0:1789498643.906539:0:15007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a/ffff98ea8925f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789498643.906548:0:15007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789498643.906620:0:15007:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789498643.906635:0:15007:0:(import.c:65:import_set_state_nolock()) ffff98ea8925c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498643.906661:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2354:x1876424864676480:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 188us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498643.906668:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:3.0:1789498643.907086:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864676608 00000100:00100000:3.0:1789498643.907152:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864676608 00000100:00100000:3.0:1789498643.907199:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:3.0:1789498643.907209:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:13862:x1876424864676608:12345-192.168.201.20@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789498643.907308:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789498643.907370:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:13862:x1876424864676608:12345-192.168.201.20@tcp:33:mount.lustre.0 Request processed in 163us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498643.907377:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:3.0:1789498644.065697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498644.066599:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864676736 00000100:00100000:0.0:1789498644.066614:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864676736 00000100:00100000:0.0:1789498644.066706:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:0.0:1789498644.066719:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:13895:x1876424864676736:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:0.0:1789498644.066747:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498644.066775:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc195c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a47c expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498644.066863:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498644.066882:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498644.066898:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498644.066992:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498644.066997:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498644.067023:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498644.067055:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5c00/0x3a6cb1946bc195c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498644.067133:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498644.067144:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf800) 00010000:00010000:0.0:1789498644.067147:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498644.067151:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4000, rc 0) 00000100:00100000:0.0:1789498644.067241:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+7:13895:x1876424864676736:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 525us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498644.067249:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00010000:00010000:1.0:1789498644.907341:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498645.485414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885641984:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.485548:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498645.485615:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885642496:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.485656:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498645.485688:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789498645.485693:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885642112:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.485722:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498645.485743:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885642624:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.485766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498645.485802:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885642240:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.485843:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498645.490363:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885642752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498645.490461:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498645.490520:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498645.490528:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885642368:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.490557:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498645.490630:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885641984 00000100:00100000:2.0:1789498645.490642:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885641984 00000100:00100000:2.0:1789498645.490716:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789498645.490726:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885641984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.490797:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885641984:12345-0@lo:400:kworker.0 Request processed in 72us (5249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498645.490804:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789498645.490843:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885642496 00000100:00100000:2.0:1789498645.490847:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885642496 00000100:00100000:2.0:1789498645.491853:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885642624 00000100:00100000:2.0:1789498645.491866:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885642624 00000100:00100000:2.0:1789498645.492044:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885642368 00000100:00100000:2.0:1789498645.492048:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885642368 00000100:00100000:2.0:1789498645.492066:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498645.492075:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885642496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.492184:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885642496:12345-0@lo:400:kworker.0 Request processed in 109us (6527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498645.492191:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498645.492207:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789498645.492214:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885642624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.492244:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885642624:12345-0@lo:400:kworker.0 Request processed in 31us (6478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498645.492274:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789498645.492286:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498645.492292:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885642368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.492342:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885642368:12345-0@lo:400:kworker.0 Request processed in 50us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498645.492349:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498645.492378:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885642112 00000100:00100000:2.0:1789498645.492382:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885642112 00000100:00100000:2.0:1789498645.492421:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885642240 00000100:00100000:2.0:1789498645.492425:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885642240 00000100:00100000:2.0:1789498645.492441:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498645.492447:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885642112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.492495:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885642112:12345-0@lo:400:kworker.0 Request processed in 48us (6772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498645.492501:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498645.492512:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498645.492517:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885642240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.492553:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885642240:12345-0@lo:400:kworker.0 Request processed in 36us (6709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498645.492559:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498645.492594:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885642752 00000100:00100000:2.0:1789498645.492598:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885642752 00000100:00100000:2.0:1789498645.492619:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789498645.492625:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885642752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498645.492666:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498645.492702:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885642752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498645.492718:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789498645.492790:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885642112:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.492807:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885642624:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.492820:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885641984:0@lo:400:kworker.0 00000100:00100000:2.0:1789498645.492849:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885642496:0@lo:400:kworker.0 00000100:00080000:2.0:1789498645.497231:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498645.497246:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498645.497250:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498645.503838:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885642368:0@lo:400:kworker.0 00000100:00100000:1.0:1789498645.503872:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789498645.503912:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885642752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498645.503927:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885642240:0@lo:400:kworker.0 00000001:00100000:1.0:1789498645.592120:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000001:00100000:1.0:1789498645.592152:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68cd9685-a43a-48ba-9cd1-2238ca644a97 00010000:00010000:2.0:1789498645.931286:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789498646.109135:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000001:00100000:3.0:1789498646.109160:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68cd9685-a43a-48ba-9cd1-2238ca644a97 00010000:00010000:3.0:1789498646.958823:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498647.021131:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885642880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498647.021234:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498647.021339:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885642880 00000100:00100000:3.0:1789498647.021349:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885642880 00000100:00100000:3.0:1789498647.021428:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498647.021451:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885642880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498647.021510:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498647.021567:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885642880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498647.021576:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789498647.021603:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498647.021653:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885642880:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789498647.411622:0:16288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789498647.982030:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789498648.171561:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000040:00080000:0.0:1789498648.428025:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789498648.977933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498648.977985:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498648.978007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498648.978033:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498648.978051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498648.978072:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498648.978121:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498648.978158:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864677248 00000100:00100000:2.0:1789498648.978174:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864677248 00000100:00100000:2.0:1789498648.979573:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864677504 00000100:00100000:2.0:1789498648.979587:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864677504 00000100:00100000:2.0:1789498648.979612:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864677120 00000100:00100000:2.0:1789498648.979615:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864677120 00000100:00100000:2.0:1789498648.979629:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864677632 00000100:00100000:2.0:1789498648.979631:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864677632 00000100:00100000:2.0:1789498648.979656:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498648.979670:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2356:x1876424864677248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498648.979793:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2356:x1876424864677248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 126us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498648.979801:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498648.979823:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1789498648.979829:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2356:x1876424864677504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498648.979851:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2356:x1876424864677504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498648.979857:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1789498648.979866:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498648.979871:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2356:x1876424864677120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498648.979892:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2356:x1876424864677120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498648.979898:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498648.979908:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498648.979914:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2356:x1876424864677632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498648.979937:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2356:x1876424864677632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498648.979944:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498648.979978:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864676864 00000100:00100000:2.0:1789498648.979982:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864676864 00000100:00100000:2.0:1789498648.980016:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:2.0:1789498648.980023:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864676864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498648.980049:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864676864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498648.980063:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:2.0:1789498648.980136:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864676992 00000100:00100000:2.0:1789498648.980140:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864676992 00000100:00100000:2.0:1789498648.980171:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864677376 00000100:00100000:2.0:1789498648.980174:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864677376 00000100:00100000:2.0:1789498648.980189:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:3.0:1789498648.981524:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789498648.981546:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1789498648.981582:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498648.981589:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498648.981592:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498648.986273:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864676992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498648.986539:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864676992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 6336us (8616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498648.986555:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498648.986602:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:2.0:1789498648.986619:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864677376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498648.986648:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864677376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (8575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498648.986655:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00010000:00010000:2.0:1789498649.011687:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498650.030277:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498650.618841:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885643008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498650.618941:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498650.619039:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885643008 00000100:00100000:0.0:1789498650.619425:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885643008 00000100:00100000:0.0:1789498650.619518:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789498650.619529:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885643008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498650.619588:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498650.619671:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885643008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498650.619679:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789498650.619705:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498650.619868:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885643008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498650.620446:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885643264:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.620497:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498650.620538:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498650.620544:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885643392:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.620570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498650.620603:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885643264 00000100:00100000:0.0:1789498650.620609:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885643264 00000100:00100000:0.0:1789498650.620658:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789498650.620666:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885643264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.620710:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885643264:12345-0@lo:400:kworker.0 Request processed in 46us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498650.620717:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789498650.620735:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885643392 00000100:00100000:0.0:1789498650.620738:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885643392 00000100:00100000:0.0:1789498650.620761:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789498650.620767:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885643392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.620794:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885643392:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498650.620799:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789498650.620825:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885643136:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.620857:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498650.620898:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885643648:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.620925:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498650.620944:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498650.620948:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885643520:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.620966:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498650.625582:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885643136 00000100:00100000:0.0:1789498650.625606:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885643136 00000100:00100000:0.0:1789498650.625693:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789498650.625704:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.625807:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885643136:12345-0@lo:400:kworker.0 Request processed in 105us (4947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498650.625816:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789498650.625865:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885643648 00000100:00100000:0.0:1789498650.625870:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885643648 00000100:00100000:0.0:1789498650.625908:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885643520 00000100:00100000:0.0:1789498650.625912:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885643520 00000100:00100000:0.0:1789498650.625935:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789498650.625942:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885643648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.625981:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885643648:12345-0@lo:400:kworker.0 Request processed in 40us (5055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498650.625987:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789498650.625999:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789498650.626005:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885643520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.626034:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885643520:12345-0@lo:400:kworker.0 Request processed in 29us (5066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498650.626040:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789498650.626065:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498650.626082:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498650.626148:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885643392:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.626165:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885643264:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.626206:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885643520:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.626215:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885643136:0@lo:400:kworker.0 00000100:00100000:0.0:1789498650.626225:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885643648:0@lo:400:kworker.0 00010000:00010000:1.0:1789498651.056751:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789498651.877890:0:16439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee75354c0 20000000:00000080:1.0:1789498651.877925:0:16439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98ea9162ec00 uarg=0000000000000000 20000000:01000000:1.0:1789498651.878003:0:16439:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789498651.878014:0:16439:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789498651.878023:0:16439:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789498651.881947:0:16440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789498651.882267:0:16439:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789498651.891674:0:16439:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789498651.891725:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.891758:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.891767:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.891775:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.891787:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.891795:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.891804:0:16439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.891957:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.891980:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 12 pid: 14315 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.892003:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885643776:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498651.892502:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.892514:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 12 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.892523:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885643904:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498651.892559:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.892569:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 18 pid: 14318 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.892580:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885644032:0@lo:104: 00000100:00100000:0.0:1789498651.892636:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498651.892688:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.892696:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 18 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.892719:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885644160:0@lo:104: 00000100:00100000:0.0:1789498651.892742:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498651.892765:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498651.892774:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 18 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.892783:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885644288:0@lo:104: 00000100:00100000:0.0:1789498651.892816:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498651.892827:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498651.892988:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789498651.893005:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885644032 00000100:00100000:3.0:1789498651.893015:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885644032 00000100:00100000:3.0:1789498651.893072:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885644160 00000100:00100000:3.0:1789498651.893076:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885644160 00000100:00100000:3.0:1789498651.893110:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885644288 00000100:00100000:3.0:1789498651.893113:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885644288 00000100:00100000:3.0:1789498651.893130:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498651.893141:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+5:16439:x1876424885644032:12345-0@lo:104: 00010000:00010000:3.0:1789498651.893159:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.898510:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789498651.898538:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+5:16439:x1876424885644032:12345-0@lo:104: Request processed in 5389us (5892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498651.898555:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498651.898615:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498651.898633:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+4:16439:x1876424885644160:12345-0@lo:104: 00010000:00010000:3.0:1789498651.898662:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.898769:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789498651.898775:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+4:16439:x1876424885644160:12345-0@lo:104: Request processed in 153us (6032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498651.898804:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498651.898820:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498651.898828:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea81325050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:16439:x1876424885644288:12345-0@lo:104: 00010000:00010000:3.0:1789498651.898838:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899191:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789498651.899198:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea81325050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+3:16439:x1876424885644288:12345-0@lo:104: Request processed in 371us (6381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498651.899205:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789498651.899271:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789498651.899279:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899288:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90200 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498651.899293:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899303:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498651.899311:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498651.899317:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789498651.899423:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899431:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498651.899804:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899812:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad90200/0x3a6cb1946bc19449 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19450 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899832:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498651.899835:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899842:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498651.899845:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899921:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498651.899928:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498651.899934:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789498651.899952:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899959:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498651.899966:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899972:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc1930e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19315 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.899994:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498651.899997:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900004:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498651.900006:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900013:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498651.900020:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498651.900025:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789498651.900038:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900044:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789498651.900118:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885644672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498651.900188:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498651.900276:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885644672 00000100:00100000:2.0:1789498651.900288:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885644672 00010000:00010000:2.0:1789498651.900327:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 19 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498651.900370:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498651.900379:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885644672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498651.900393:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498651.900400:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 19 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498651.900427:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 19 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498651.900452:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498651.900523:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900532:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc192c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc192c8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900550:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498651.900552:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498651.900554:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498651.900563:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498651.900579:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498651.900604:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885644416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498651.900641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498651.900668:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498651.900675:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98772aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885644544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498651.900701:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498651.900727:0:14308:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789498651.900736:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789498651.900758:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789498651.900768:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885644416 00000100:00100000:3.0:1789498651.900771:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885644416 00010000:00010000:3.0:1789498651.900789:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 20 pid: 14318 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498651.900804:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789498651.900811:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885644544 00000100:00100000:3.0:1789498651.900814:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885644544 00010000:00010000:3.0:1789498651.900824:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 21 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498651.900834:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789498651.900852:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498651.900859:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf59db6-3bc5-4ded-8751-c46e361eaced+21:3305:x1876424885644416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498651.900867:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498651.900872:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 21 pid: 14318 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900881:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 21 pid: 14318 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900892:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498651.900930:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf59db6-3bc5-4ded-8751-c46e361eaced+21:3305:x1876424885644416:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498651.900938:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498651.900954:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789498651.900960:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498651.900966:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf59db6-3bc5-4ded-8751-c46e361eaced+20:3305:x1876424885644544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498651.900973:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498651.900977:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 20 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900985:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 20 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.900995:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498651.901015:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf59db6-3bc5-4ded-8751-c46e361eaced+20:3305:x1876424885644544:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498651.901021:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498651.901061:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98772aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885644544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498651.901071:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885644416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498651.904169:0:16439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6555e00/0x3a6cb1946bc19450 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19449 expref: 19 pid: 14318 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.904202:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885644032:0@lo:104: 00010000:00010000:0.0:1789498651.904217:0:16439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad90a00/0x3a6cb1946bc19315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc1930e expref: 18 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.904227:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885644160:0@lo:104: 00010000:00010000:0.0:1789498651.904240:0:16439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddfc00/0x3a6cb1946bc192c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc192c1 expref: 17 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.904249:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885644288:0@lo:104: 00000100:00100000:0.0:1789498651.904818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498651.904935:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864677760 00000100:00100000:3.0:1789498651.904947:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864677760 00010000:00010000:3.0:1789498651.905001:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 13 pid: 14315 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498651.905040:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:3.0:1789498651.905051:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864677760:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498651.905071:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498651.905120:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 13 pid: 14315 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.905135:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 13 pid: 14315 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.905162:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498651.905244:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864677760:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 194us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498651.905253:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00010000:00010000:3.0:1789498651.905304:0:16439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac1e00800/0x3a6cb1946bc195a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a452 expref: 12 pid: 14315 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498651.905317:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885643776:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498651.905328:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1876424885643904:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498651.905383:0:16439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498651.905460:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498651.905913:0:16441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864677888 00000100:00100000:3.0:1789498651.905920:0:16441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864677888 00010000:00010000:3.0:1789498651.905944:0:16441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 12 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498651.905977:0:16441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1789498651.905984:0:16441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7e869000-0a12-4277-a881-2610e585c112+12:2356:x1876424864677888:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498651.905995:0:16441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498651.906000:0:16441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 12 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906026:0:16441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 12 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906039:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554c00/0x3a6cb1946bc1956f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3f0 expref: 12 pid: 14316 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906056:0:16441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906066:0:16441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906086:0:16441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906123:0:16441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906132:0:16441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906141:0:16441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906148:0:16441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498651.906154:0:16441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906163:0:16441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906188:0:16441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906200:0:16441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498651.906219:0:16439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906228:0:16439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498651.906234:0:16439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc195d1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498651.908544:0:16441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7e869000-0a12-4277-a881-2610e585c112+11:2356:x1876424864677888:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 2539us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498651.908563:0:16441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498651.918434:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3307:x1876424885644672:12345-0@lo:103:ldlm_bl.0 Request processed in 18038us (18228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498651.918455:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498651.918982:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885644672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498652.079067:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498652.160013:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885644800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498652.160084:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498652.164625:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885644800 00000100:00100000:0.0:1789498652.164645:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885644800 00000100:00100000:0.0:1789498652.164744:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789498652.164755:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885644800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498652.164806:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498652.164913:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885644800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (4827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498652.164921:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789498652.164944:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498652.165000:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885644800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789498653.099250:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498653.268186:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498653.268508:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864678016 00000100:00100000:3.0:1789498653.268525:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864678016 00000100:00100000:3.0:1789498653.268614:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:3.0:1789498653.268625:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+11:13746:x1876424864678016:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498653.268651:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498653.268680:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad90200/0x3a6cb1946bc195d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a483 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498653.268719:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad90200/0x3a6cb1946bc195d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a483 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498653.268755:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad90200/0x3a6cb1946bc195d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a483 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498653.268767:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90200, rc 0) 00000100:00100000:3.0:1789498653.268854:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+12:13746:x1876424864678016:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 231us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498653.268863:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:0.0:1789498653.274225:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498653.274317:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864678144 00000100:00100000:3.0:1789498653.274340:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864678144 00000100:00100000:3.0:1789498653.274413:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 108 00000100:00100000:3.0:1789498653.274426:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+12:13746:x1876424864678144:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498653.274840:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+12:13746:x1876424864678144:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 414us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498653.274849:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 108 00000100:00100000:3.0:1789498653.290315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498653.290436:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864678272 00000100:00100000:2.0:1789498653.290451:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864678272 00000100:00100000:2.0:1789498653.290527:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:2.0:1789498653.290539:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+12:13746:x1876424864678272:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498653.290951:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+12:13746:x1876424864678272:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 404us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498653.290960:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:3.0:1789498653.300082:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498653.300225:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864678400 00000100:00100000:0.0:1789498653.300239:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864678400 00000100:00100000:0.0:1789498653.300313:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 110 00000100:00100000:0.0:1789498653.300343:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+12:13746:x1876424864678400:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498653.300374:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498653.300400:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa5400/0x3a6cb1946bc195df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a48a expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498653.300455:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa5400/0x3a6cb1946bc195df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a48a expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498653.300469:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa5400/0x3a6cb1946bc195df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a48a expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498653.300479:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5400, rc 0) 00000100:00100000:0.0:1789498653.300551:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:13746:x1876424864678400:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 228us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498653.300575:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 110 00000100:00100000:0.0:1789498653.303498:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498653.303639:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864678528 00000100:00100000:3.0:1789498653.303654:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864678528 00000100:00100000:3.0:1789498653.303724:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 111 00000100:00100000:3.0:1789498653.303736:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:13746:x1876424864678528:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498653.304225:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:13746:x1876424864678528:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 489us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498653.304236:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 111 00000100:00100000:3.0:1789498653.310891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498653.310988:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864678656 00000100:00100000:1.0:1789498653.311002:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864678656 00000100:00100000:1.0:1789498653.311073:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 112 00000100:00100000:1.0:1789498653.311085:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:13746:x1876424864678656:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.321887:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:13746:x1876424864678656:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 10779us (10990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.321922:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 112 10000000:01000000:1.0:1789498653.614545:0:14320:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789498653.614555:0:14320:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eabfb3d800 from 10 10000000:01000000:1.0:1789498653.614562:0:14320:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789498653.614634:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.614650:0:14320:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.614664:0:14320:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498653.614698:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885644928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.614807:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498653.614869:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.614905:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885644928 00000100:00100000:1.0:1789498653.614916:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885644928 00000100:00100000:1.0:1789498653.614975:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789498653.614985:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:14320:x1876424885644928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498653.615006:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498653.615022:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e01200/0x3a6cb1946bc195ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc195e6 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.615053:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e01200/0x3a6cb1946bc195ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc195e6 expref: 17 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.615067:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e01200/0x3a6cb1946bc195ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc195e6 expref: 17 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.615079:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01200, rc 0) 00000100:00100000:1.0:1789498653.615141:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:14320:x1876424885644928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.615148:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789498653.615217:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885644928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498653.615233:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.615244:0:14320:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498653.615319:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.615372:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498653.615393:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.615408:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885645056 00000100:00100000:1.0:1789498653.615412:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885645056 00000100:00100000:1.0:1789498653.615437:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789498653.615443:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:14320:x1876424885645056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.615768:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:14320:x1876424885645056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.615775:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789498653.615808:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.615840:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.615882:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498653.615895:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.615908:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885645184 00000100:00100000:1.0:1789498653.615911:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885645184 00000100:00100000:1.0:1789498653.615932:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789498653.615939:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:14320:x1876424885645184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.616135:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:14320:x1876424885645184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.616142:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789498653.616181:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789498653.616843:0:16500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789498653.616919:0:14320:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789498653.616941:0:14320:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789498653.616954:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.616980:0:14320:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498653.616993:0:14320:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789498653.616996:0:14320:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e98441a800 from 10 10000000:01000000:1.0:1789498653.617000:0:14320:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789498653.617038:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.617046:0:14320:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.617056:0:14320:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498653.617078:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.617156:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498653.617188:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.617206:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885645312 00000100:00100000:1.0:1789498653.617212:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885645312 00000100:00100000:1.0:1789498653.617245:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789498653.617254:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:14320:x1876424885645312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498653.617268:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498653.617284:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e01e00/0x3a6cb1946bc195fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc195f4 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.617310:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e01e00/0x3a6cb1946bc195fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc195f4 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.617479:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e01e00/0x3a6cb1946bc195fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc195f4 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.617490:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01e00, rc 0) 00000100:00100000:1.0:1789498653.617526:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:14320:x1876424885645312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.617533:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789498653.617572:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498653.617586:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.617594:0:14320:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498653.617642:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.617667:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498653.617680:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.617692:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885645440 00000100:00100000:1.0:1789498653.617695:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885645440 00000100:00100000:1.0:1789498653.617718:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789498653.617724:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:14320:x1876424885645440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.617985:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:14320:x1876424885645440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.617993:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789498653.618025:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.618061:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.618131:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498653.618150:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.618161:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885645568 00000100:00100000:1.0:1789498653.618165:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885645568 00000100:00100000:1.0:1789498653.618186:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789498653.618192:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:14320:x1876424885645568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.618446:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:14320:x1876424885645568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.618453:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789498653.618489:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789498653.622007:0:16501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789498653.623258:0:14320:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789498653.623398:0:14320:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789498653.623416:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498653.623432:0:14320:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498653.623447:0:14320:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789498653.623451:0:14320:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98eaba3b0800 from 10 10000000:01000000:0.0:1789498653.623454:0:14320:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498653.623510:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498653.623519:0:14320:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498653.623533:0:14320:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498653.623569:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498653.623660:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498653.623717:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82d8ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.623776:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885645696 00000100:00100000:1.0:1789498653.623787:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885645696 00000100:00100000:1.0:1789498653.623856:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789498653.623867:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:14320:x1876424885645696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498653.623885:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498653.623900:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e01000/0x3a6cb1946bc19609 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19602 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.623930:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e01000/0x3a6cb1946bc19609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19602 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.623943:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e01000/0x3a6cb1946bc19609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19602 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.623953:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01000, rc 0) 00000100:00100000:1.0:1789498653.624023:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:14320:x1876424885645696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.624031:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789498653.624117:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498653.624137:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.624146:0:14320:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498653.624205:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.624230:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498653.624249:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.624264:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885645824 00000100:00100000:1.0:1789498653.624267:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885645824 00000100:00100000:1.0:1789498653.625447:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789498653.625457:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:14320:x1876424885645824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.625823:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:14320:x1876424885645824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 366us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.625832:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789498653.625894:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.625951:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.626001:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498653.626031:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789498653.626046:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885645952 00000100:00100000:1.0:1789498653.626052:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885645952 00000100:00100000:1.0:1789498653.626084:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789498653.626113:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:14320:x1876424885645952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498653.628358:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:14320:x1876424885645952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2253us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498653.628378:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789498653.634642:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1cf59db6-3bc5-4ded-8751-c46e361eaced:14320:1876424885645952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789498653.642064:0:16504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789498653.642201:0:14320:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789498653.642224:0:14320:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789498653.642239:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498653.642253:0:14320:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498654.094609:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498654.094663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498654.094709:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864678784 00000100:00100000:1.0:1789498654.094724:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864678784 00000100:00100000:0.0:1789498654.094754:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864678912 00000100:00100000:0.0:1789498654.094761:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864678912 00000100:00100000:1.0:1789498654.094806:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:1.0:1789498654.094819:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864678784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498654.094837:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1789498654.094848:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864678912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498654.094912:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864678784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 95us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498654.094920:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00080000:1.0:1789498654.097402:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498654.099869:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864678912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5004us (5185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498654.099890:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:3.0:1789498654.100020:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498654.101448:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498654.101490:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498654.101522:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498654.101550:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498654.101591:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864679168 00000100:00100000:3.0:1789498654.101606:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864679168 00000100:00100000:3.0:1789498654.101668:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864679424 00000100:00100000:3.0:1789498654.101672:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864679424 00000100:00100000:3.0:1789498654.101686:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864679040 00000100:00100000:3.0:1789498654.101689:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864679040 00000100:00100000:3.0:1789498654.101703:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864679552 00000100:00100000:3.0:1789498654.101705:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864679552 00000100:00100000:3.0:1789498654.101725:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498654.101735:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864679168:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498654.101963:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864679168:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 227us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498654.101973:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498654.101991:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1789498654.101997:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2355:x1876424864679424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498654.102024:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2355:x1876424864679424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498654.102030:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1789498654.102040:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498654.102046:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864679040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498654.103388:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864679040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 43us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498654.103405:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498654.103441:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:3.0:1789498654.103456:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2355:x1876424864679552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498654.103526:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2355:x1876424864679552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498654.103533:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:3.0:1789498654.103564:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864679296 00000100:00100000:3.0:1789498654.103573:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864679296 00000100:00100000:3.0:1789498654.103635:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:3.0:1789498654.103642:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864679296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498654.103674:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864679296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498654.103680:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00080000:3.0:1789498654.106532:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498654.106548:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498654.106551:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789498654.124433:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498655.147375:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498655.618165:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498655.618363:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864679680 00000100:00100000:0.0:1789498655.618378:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864679680 00000100:00100000:0.0:1789498655.618478:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1789498655.618492:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:14405:x1876424864679680:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498655.618522:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498655.618550:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a491 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.618645:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.618666:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.618684:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.618714:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.618721:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.618729:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619594:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc19625 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619609:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc19625 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619618:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc19625 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498655.619657:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498655.619661:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498655.619710:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc19625 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619723:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619730:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619738:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619883:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498655.619889:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619898:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.619914:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf800) 00010000:00010000:0.0:1789498655.620032:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498655.620042:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620049:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620067:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620073:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620080:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620085:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498655.620230:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620238:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620247:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498655.620250:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498655.620254:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620260:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc1961e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620325:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a491 expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620357:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc19625 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a491 expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.620366:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98ea84ebf400) 00010000:00010000:0.0:1789498655.620368:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498655.620371:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5a00, rc 0) 00000100:00100000:0.0:1789498655.620479:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:14405:x1876424864679680:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1990us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498655.620491:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498655.625416:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498655.631216:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864679936 00000100:00100000:2.0:1789498655.631244:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864679936 00000100:00100000:2.0:1789498655.631367:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:2.0:1789498655.631381:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:14405:x1876424864679936:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498655.631417:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498655.631454:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc1962c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a498 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.631565:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.631585:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.631622:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.631642:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.631651:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.631659:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632220:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc19641 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632236:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc19641 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632243:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc19641 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498655.632256:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789498655.632549:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632558:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632567:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632574:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.632587:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632597:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632614:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98ea84ebf400) 00010000:00010000:2.0:1789498655.632618:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.632625:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632632:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19633 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632649:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632656:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632663:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632669:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.632672:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632679:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632687:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98ea82c62500) 00010000:00010000:2.0:1789498655.632689:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.632701:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.632707:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1963a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.633481:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc1962c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a498 expref: 10 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.633505:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc19641 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a498 expref: 9 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.633513:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea82c62800) 00010000:00010000:2.0:1789498655.633516:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.633519:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6555000, rc 0) 00000100:00100000:2.0:1789498655.633626:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14405:x1876424864679936:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 2246us (8227us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789498655.633635:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:1.0:1789498655.640767:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498655.640848:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864680064 00000100:00100000:2.0:1789498655.640864:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864680064 00000100:00100000:2.0:1789498655.640960:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1789498655.640972:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14405:x1876424864680064:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789498655.641153:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14405:x1876424864680064:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 Request processed in 182us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498655.641163:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:0.0:1789498655.705999:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498655.706134:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864680192 00000100:00100000:2.0:1789498655.706148:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864680192 00000100:00100000:2.0:1789498655.706228:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:2.0:1789498655.706240:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14412:x1876424864680192:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498655.706299:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498655.706328:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc1964f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a49f expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.706411:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.706430:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.706445:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.706463:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.706482:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.706489:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707007:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707018:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707026:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707032:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.707043:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707052:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707066:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf800) 00010000:00010000:2.0:1789498655.707069:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.707075:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707259:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc19656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707281:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707301:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707308:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707314:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.707317:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707324:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707334:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98ea82c62500) 00010000:00010000:2.0:1789498655.707336:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.707347:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707353:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc1965d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707404:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc1964f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a49f expref: 10 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707417:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf800) 00010000:00010000:2.0:1789498655.707421:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.707424:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc1964f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a49f expref: 10 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.707436:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554c00, rc 0) 00000100:00100000:2.0:1789498655.707540:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14412:x1876424864680192:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1300us (1554us total) trans 0 rc 301/301 00000100:00100000:2.0:1789498655.707551:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:0.0:1789498655.718800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498655.719010:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864680320 00000100:00100000:3.0:1789498655.719036:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864680320 00000100:00100000:3.0:1789498655.719131:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:3.0:1789498655.719142:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14412:x1876424864680320:12345-192.168.201.20@tcp:700:lfs.0 00000100:00100000:3.0:1789498655.719277:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14412:x1876424864680320:12345-192.168.201.20@tcp:700:lfs.0 Request processed in 137us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498655.719296:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1789498655.723520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498655.724862:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885646080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498655.724950:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498655.725053:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885646080 00000100:00100000:0.0:1789498655.725064:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885646080 00000100:00100000:0.0:1789498655.725166:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789498655.725179:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885646080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498655.725230:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498655.725304:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885646080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498655.725313:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789498655.725377:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885646080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498655.725404:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864680576 00000100:00100000:0.0:1789498655.725408:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864680576 00000100:00100000:0.0:1789498655.725437:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:0.0:1789498655.725460:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14412:x1876424864680576:12345-192.168.201.20@tcp:36:lfs.0 00000100:00080000:3.0:1789498655.725823:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498655.726879:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885646464:0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.726908:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885646336:0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.726976:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498655.726977:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498655.727072:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885646336 00000100:00100000:3.0:1789498655.727083:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885646336 00010000:00010000:0.0:1789498655.727179:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789498655.727185:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498655.727200:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885646336:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1789498655.727225:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19592 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a41a expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.727250:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf800) 00010000:00010000:0.0:1789498655.727258:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498655.727562:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.727579:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 5 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.727590:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.727627:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 5 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.727642:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 5 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498655.727740:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885646208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.727804:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498655.727841:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885646720:0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.727876:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498655.727904:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498655.727910:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885646592:0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.727939:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498655.727963:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885646208 00000100:00100000:1.0:1789498655.727969:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885646208 00000100:00100000:0.0:1789498655.727998:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885646848:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498655.728010:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789498655.728019:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885646208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.728071:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885646208:12345-0@lo:400:kworker.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498655.728075:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84b16f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498655.728081:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789498655.728146:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498655.728163:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885646464 00000100:00100000:1.0:1789498655.728167:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885646464 00000100:00100000:1.0:1789498655.728186:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885646720 00000100:00100000:1.0:1789498655.728189:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885646720 00000100:00100000:1.0:1789498655.728208:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885646592 00000100:00100000:1.0:1789498655.728211:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885646592 00000100:00100000:1.0:1789498655.728225:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498655.728230:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885646464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.728262:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885646464:12345-0@lo:400:kworker.0 Request processed in 32us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498655.728268:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498655.728279:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498655.728300:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885646720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.728345:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885646720:12345-0@lo:400:kworker.0 Request processed in 60us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498655.728352:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498655.728363:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789498655.728370:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885646592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.728395:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885646592:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498655.728400:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789498655.728412:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498655.728442:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885646592:0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.728451:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885646208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.728459:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885646720:0@lo:400:kworker.0 00000100:00100000:2.0:1789498655.728834:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885646464:0@lo:400:kworker.0 00000100:00100000:3.0:1789498655.732203:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885646336:12345-0@lo:400:kworker.0 Request processed in 4991us (5216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498655.732225:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789498655.732654:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885646336:0@lo:400:kworker.0 00000100:00100000:1.0:1789498655.733420:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885646848:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498655.733452:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498655.738015:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498655.740253:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864680704 00000100:00100000:3.0:1789498655.740277:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864680704 00010000:00010000:3.0:1789498655.740365:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 6 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498655.740506:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:3.0:1789498655.740518:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864680704:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498655.740543:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498655.740552:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 6 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.740569:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 6 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.740600:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc195ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a47c expref: 6 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.740646:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf800) 00010000:00010000:3.0:1789498655.740653:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.740664:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.740673:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.740713:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498655.740824:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2355:x1876424864680704:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 308us (2826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498655.740833:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00010000:00010000:1.0:1789498655.740916:0:14325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.740925:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.740959:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.740978:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.740990:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498655.742571:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789498655.742593:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.742604:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.742611:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.742618:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498655.742624:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.742633:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.742650:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea84ebf800) 00010000:00010000:1.0:1789498655.742653:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498655.742658:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.742665:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19664 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498655.742704:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038eedd2e reply state 000000009efa3027 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498655.742715:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789498655.742831:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+10:14412:x1876424864680576:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 17366us (19322us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789498655.742842:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00010000:00010000:2.0:1789498655.746840:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.746982:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.746992:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.747021:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.747028:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.747038:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.747058:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98ea83c9cd00) 00010000:00010000:2.0:1789498655.747062:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.747070:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.747077:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1966b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498655.827770:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498655.827880:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864680832 00000100:00100000:3.0:1789498655.827895:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864680832 00000100:00100000:3.0:1789498655.827979:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:3.0:1789498655.827992:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14420:x1876424864680832:12345-192.168.201.20@tcp:101:lctl.0 00010000:00010000:3.0:1789498655.828028:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498655.828057:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4a6 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.828348:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19679 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.828369:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.828385:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498655.828446:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498655.828450:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498655.828498:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.828532:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4a6 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.828583:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4a6 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.828593:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:2.0:1789498655.828597:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498655.828601:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6555e00, rc 0) 00000100:00100000:2.0:1789498655.828683:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+10:14420:x1876424864680832:12345-192.168.201.20@tcp:101:lctl.0 Request processed in 694us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498655.828691:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:0.0:1789498655.845728:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498655.846043:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864680960 00000100:00100000:1.0:1789498655.846059:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864680960 00000100:00100000:1.0:1789498655.846230:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:1.0:1789498655.846243:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:14421:x1876424864680960:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498655.846292:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498655.846320:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc19680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4ad expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.846412:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc19687 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.846431:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc19687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.846445:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc19687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498655.846498:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789498655.846503:0:16313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498655.846529:0:16313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc19687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.846582:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc19680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4ad expref: 7 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.846606:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc19687 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4ad expref: 6 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.846616:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:1.0:1789498655.846619:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498655.846624:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00e00, rc 0) 00000100:00100000:1.0:1789498655.846711:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:14421:x1876424864680960:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 471us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498655.846718:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:1.0:1789498655.850813:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498655.851498:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864681088 00000100:00100000:2.0:1789498655.851514:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864681088 00000100:00100000:2.0:1789498655.851597:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1789498655.851609:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:14421:x1876424864681088:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498655.851638:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498655.851666:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1968e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4b4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851752:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851772:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851786:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851804:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851829:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851836:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851970:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc196a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851980:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc196a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.851987:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc196a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498655.852029:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498655.852033:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498655.852061:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc196a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852074:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852082:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852110:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852118:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.852123:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852137:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852151:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:2.0:1789498655.852154:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.852161:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852168:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554800/0x3a6cb1946bc19695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852185:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852191:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852197:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852202:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.852204:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852211:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852218:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98ea82c62500) 00010000:00010000:2.0:1789498655.852221:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.852224:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852239:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555200/0x3a6cb1946bc1969c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852274:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555600/0x3a6cb1946bc1968e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4b4 expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852303:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc196a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4b4 expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.852311:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62400) 00010000:00010000:2.0:1789498655.852313:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498655.852316:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554c00, rc 0) 00000100:00100000:2.0:1789498655.852409:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+7:14421:x1876424864681088:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 802us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498655.852418:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:3.0:1789498655.856174:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498655.856327:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864681344 00000100:00100000:1.0:1789498655.856342:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864681344 00000100:00100000:1.0:1789498655.856422:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:1.0:1789498655.856445:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+7:14421:x1876424864681344:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498655.856478:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498655.856504:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc196aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4bb expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498655.856631:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789498655.856810:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc196aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4bb expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.856828:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:1.0:1789498655.856848:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498655.856855:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc196aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4bb expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.856873:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00a00, rc 0) 00000100:00100000:1.0:1789498655.856956:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+8:14421:x1876424864681344:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 514us (799us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789498655.856964:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1789498655.859957:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498655.861630:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864681600 00000100:00100000:1.0:1789498655.861653:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864681600 00000100:00100000:1.0:1789498655.861760:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:1.0:1789498655.861784:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+8:14421:x1876424864681600:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:1.0:1789498655.861881:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498655.861922:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6554c00/0x3a6cb1946bc196a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4b4 expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.861952:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62400) 00010000:00010000:1.0:1789498655.861968:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498655.862001:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.862018:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.862030:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498655.862391:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001983f098 reply state 000000008e8e13fe transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498655.862427:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789498655.862439:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789498655.862568:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+9:14421:x1876424864681600:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 795us (2625us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789498655.862577:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:2.0:1789498655.865147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:1.0:1789498655.865223:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.865238:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.865247:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.865266:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498655.865273:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.865312:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.865333:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498655.865336:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789498655.865343:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.865350:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc196b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498655.865640:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864681856 00000100:00100000:3.0:1789498655.865655:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864681856 00000100:00100000:3.0:1789498655.865725:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1789498655.865738:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+8:14421:x1876424864681856:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498655.866127:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+9:14421:x1876424864681856:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 391us (992us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789498655.866135:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:1.0:1789498655.872769:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498655.872900:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864682112 00000100:00100000:2.0:1789498655.872917:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864682112 00000100:00100000:2.0:1789498655.873025:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:2.0:1789498655.873039:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+9:14421:x1876424864682112:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498655.873078:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498655.873139:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc196bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4c2 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873242:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873292:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873307:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873325:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873332:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873339:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498655.873500:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789498655.873633:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873641:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873649:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873656:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcda00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.873662:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873671:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873697:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:2.0:1789498655.873700:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.873708:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873714:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc196c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873731:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873737:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873743:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873747:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.873750:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873755:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873762:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98ea82c62500) 00010000:00010000:2.0:1789498655.873764:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.873766:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873771:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc196cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873834:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc196bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c2 expref: 11 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873846:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:2.0:1789498655.873849:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498655.873853:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc196bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c2 expref: 11 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.873862:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadccc00, rc 0) 00000100:00100000:2.0:1789498655.873964:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+10:14421:x1876424864682112:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 928us (1210us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789498655.873973:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:1.0:1789498655.876932:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498655.877039:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864682240 00000100:00100000:2.0:1789498655.877053:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864682240 00000100:00100000:2.0:1789498655.877184:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:2.0:1789498655.877197:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+10:14421:x1876424864682240:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498655.877229:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498655.877268:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc196db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4c9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.877397:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.877414:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.877427:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498655.877478:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498655.877482:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498655.877506:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.877541:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc196db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.877562:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.877572:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:2.0:1789498655.877575:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498655.877580:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcc000, rc 0) 00000100:00100000:2.0:1789498655.877663:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+11:14421:x1876424864682240:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 469us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498655.877671:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:0.0:1789498655.882980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498655.883086:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864682368 00000100:00100000:3.0:1789498655.883186:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864682368 00000100:00100000:3.0:1789498655.883275:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1789498655.883296:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+11:14421:x1876424864682368:12345-192.168.201.20@tcp:37:lfs.0 00000100:00100000:1.0:1789498655.888014:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+11:14421:x1876424864682368:12345-192.168.201.20@tcp:37:lfs.0 Request processed in 4704us (5033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498655.888037:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:1.0:1789498655.893271:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498655.893391:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864682624 00000100:00100000:2.0:1789498655.893407:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864682624 00000100:00100000:2.0:1789498655.893641:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1789498655.893655:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea87008450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+11:14421:x1876424864682624:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498655.894059:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea87008450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+12:14421:x1876424864682624:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 407us (804us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789498655.894068:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:1.0:1789498655.949823:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498655.950151:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864682752 00000100:00100000:0.0:1789498655.950168:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864682752 00000100:00100000:0.0:1789498655.950296:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1789498655.950309:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+10:14427:x1876424864682752:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498655.950337:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498655.950364:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc196e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4d0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950451:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950484:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950720:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950744:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950753:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950762:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950981:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc196fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950991:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc196fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.950999:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc196fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498655.951052:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498655.951057:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498655.951167:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc196fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951182:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951200:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951208:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951215:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498655.951220:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951228:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951241:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:0.0:1789498655.951244:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498655.951251:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951258:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc196f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951273:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951300:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951306:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951311:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498655.951316:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951323:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951331:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498655.951334:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498655.951337:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951342:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc196f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951385:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc196e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d0 expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951400:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc196fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d0 expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.951408:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:0.0:1789498655.951411:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789498655.951421:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5e00, rc 0) 00000100:00100000:0.0:1789498655.951498:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+11:14427:x1876424864682752:12345-192.168.201.20@tcp:101:bash.0 Request processed in 1193us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498655.952169:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1789498655.955426:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498655.956086:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864683008 00000100:00100000:1.0:1789498655.956127:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864683008 00000100:00100000:1.0:1789498655.956278:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:1.0:1789498655.956305:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+11:14427:x1876424864683008:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498655.956336:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498655.956364:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19705 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4d7 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.956606:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.956626:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.956636:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.956683:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498655.956699:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 11 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498655.956739:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba121f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885646976:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498655.956936:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498655.962675:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498655.962942:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba121f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885646976:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498655.962986:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498655.963737:0:16441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864683136 00000100:00100000:0.0:1789498655.963751:0:16441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864683136 00010000:00010000:0.0:1789498655.963906:0:16441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 12 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498655.963989:0:16441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1789498655.964001:0:16441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+12:2355:x1876424864683136:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498655.964023:0:16441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498655.964032:0:16441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 12 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.964046:0:16441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 12 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.964074:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc196e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4c9 expref: 12 pid: 14323 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.964114:0:16441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:0.0:1789498655.964121:0:16441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.964133:0:16441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.964141:0:16441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498655.964191:0:16441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498655.964341:0:16441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+11:2355:x1876424864683136:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 341us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498655.964349:0:16441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00010000:00010000:3.0:1789498655.964806:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.964818:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.964852:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.964864:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.964874:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966243:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966301:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966312:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498655.966327:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789498655.966371:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966379:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966386:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966393:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498655.966398:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966405:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966419:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:3.0:1789498655.966423:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498655.966428:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.966435:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1970c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498655.966450:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2012ed2 reply state 00000000c377d5f3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498655.967837:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789498655.967985:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19705 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.968013:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498655.968022:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498655.968025:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789498655.968029:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90e00, rc 0) 00000100:00100000:3.0:1789498655.968165:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14427:x1876424864683008:12345-192.168.201.20@tcp:101:bash.0 Request processed in 11862us (12751us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789498655.968174:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00010000:00010000:2.0:1789498655.975142:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.975195:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.975204:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.975210:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498655.975217:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.975226:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.975249:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea9108c200) 00010000:00010000:2.0:1789498655.975252:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498655.975258:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.975265:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19713 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498655.982758:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498655.982878:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864683264 00000100:00100000:2.0:1789498655.982892:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864683264 00000100:00100000:2.0:1789498655.982971:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1789498655.982982:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+13:14427:x1876424864683264:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498655.983013:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498655.983040:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19728 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4de expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.983211:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.983249:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.983264:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498655.983376:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789498655.983381:0:16313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498655.983409:0:16313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.983422:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.983453:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19728 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 15 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.983486:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 14 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498655.983495:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498655.983498:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498655.983502:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcc800, rc 0) 00000100:00100000:2.0:1789498655.983579:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14427:x1876424864683264:12345-192.168.201.20@tcp:101:bash.0 Request processed in 599us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498655.983588:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:1.0:1789498655.989504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498655.989803:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864683520 00000100:00100000:3.0:1789498655.989819:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864683520 00000100:00100000:3.0:1789498655.989902:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:3.0:1789498655.989915:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14427:x1876424864683520:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:3.0:1789498655.990469:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14427:x1876424864683520:12345-192.168.201.20@tcp:35:bash.0 Request processed in 553us (977us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789498655.990478:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:1.0:1789498656.058708:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498656.059605:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864683776 00000100:00100000:2.0:1789498656.059624:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864683776 00000100:00080000:1.0:1789498656.059787:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498656.059950:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:2.0:1789498656.059965:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14437:x1876424864683776:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498656.060000:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498656.060028:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4e5 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498656.060180:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789498656.060364:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19736 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4e5 expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.060380:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:2.0:1789498656.060384:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498656.060390:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4e5 expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.060408:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadccc00, rc 0) 00000100:00100000:2.0:1789498656.060497:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+16:14437:x1876424864683776:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 537us (1803us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789498656.060505:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:1.0:1789498656.063646:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498656.063716:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864684032 00000100:00100000:3.0:1789498656.063731:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864684032 00000100:00100000:3.0:1789498656.063807:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:3.0:1789498656.063818:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+16:14437:x1876424864684032:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498656.064203:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:14437:x1876424864684032:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 385us (570us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789498656.064525:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:1.0:1789498656.087502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498656.087621:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864684288 00000100:00100000:2.0:1789498656.087633:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864684288 00000100:00100000:2.0:1789498656.087762:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1789498656.087774:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:14440:x1876424864684288:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498656.087819:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498656.087847:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19744 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4ec expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.088014:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc1974b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.088029:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc1974b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.088040:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc1974b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498656.088051:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498656.088438:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19744 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4ec expref: 20 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.088454:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc1974b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4ec expref: 19 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.088461:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498656.088464:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789498656.088467:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcda00, rc 0) 00000100:00100000:2.0:1789498656.088574:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14440:x1876424864684288:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 801us (1083us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789498656.088582:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:1.0:1789498656.091750:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498656.091826:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864684416 00000100:00100000:3.0:1789498656.091840:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864684416 00000100:00100000:3.0:1789498656.091970:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1789498656.091981:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14440:x1876424864684416:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:3.0:1789498656.092060:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092086:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092150:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092205:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092211:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092216:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092220:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498656.092224:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092229:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092241:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498656.092258:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498656.092264:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.092271:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19759 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498656.092378:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14440:x1876424864684416:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 398us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498656.092386:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00010000:00010000:0.0:1789498656.171505:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789498656.326603:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1789498656.326628:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:0.0:1789498656.326635:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:0.0:1789498656.326643:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1789498656.394229:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498656.394385:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864684672 00000100:00100000:0.0:1789498656.394399:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864684672 00000100:00100000:0.0:1789498656.394492:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:0.0:1789498656.394505:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+12:14477:x1876424864684672:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1789498656.394536:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498656.394565:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19760 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4f3 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.394717:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.394735:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.394745:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 13 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.394755:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.394832:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 13 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.394858:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 13 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498656.394875:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885647104:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498656.395010:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.395021:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 13 pid: 14324 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498656.395030:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885647232:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498656.395056:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84b166c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498656.399829:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885647104:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498656.399867:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885647232:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498656.399906:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498656.400797:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498656.400854:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498656.400937:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864684800 00000100:00100000:3.0:1789498656.400947:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864684800 00010000:00010000:3.0:1789498656.401005:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 14 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498656.401047:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864684928 00000100:00100000:3.0:1789498656.401051:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864684928 00010000:00010000:3.0:1789498656.401064:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 15 pid: 14324 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498656.401139:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:3.0:1789498656.401150:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:2355:x1876424864684800:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498656.401171:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498656.401180:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 15 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401195:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 15 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401248:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc1972f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4de expref: 15 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401292:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498656.401299:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401308:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401316:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498656.401389:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864684800:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 240us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498656.401397:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:3.0:1789498656.401417:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:3.0:1789498656.401423:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+13:2355:x1876424864684928:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498656.401431:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498656.401436:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 13 pid: 14324 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401446:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 13 pid: 14324 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401456:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1971a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d7 expref: 13 pid: 14324 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401482:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498656.401485:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401492:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401501:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.401526:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498656.401544:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+12:2355:x1876424864684928:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 122us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498656.401550:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00010000:00010000:0.0:1789498656.401893:0:14325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.401902:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498656.401938:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789498656.402298:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19760 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 13 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.402319:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498656.402327:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:0.0:1789498656.402330:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789498656.402333:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4600, rc 0) 00000100:00100000:0.0:1789498656.402385:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+12:14477:x1876424864684672:12345-192.168.201.20@tcp:101:dd.0 Request processed in 7882us (8172us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789498656.402393:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:1.0:1789498656.406666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498656.406786:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864685184 00000100:00100000:2.0:1789498656.406800:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864685184 00000100:00100000:2.0:1789498656.406870:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:2.0:1789498656.406880:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+12:14477:x1876424864685184:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1789498656.407331:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.407369:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.407383:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498656.407448:0:14323:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:2.0:1789498656.407479:0:14323:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028ee0a97 reply state 000000007687da34 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498656.407488:0:14323:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498656.407597:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14477:x1876424864685184:12345-192.168.201.20@tcp:36:dd.0 Request processed in 717us (945us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789498656.407604:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000020:00080000:2.0:1789498656.407611:0:14323:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498656.410605:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.410630:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.410640:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.410648:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadccc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498656.410654:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.410664:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.410712:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498656.410716:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498656.410723:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.410730:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19775 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498656.620719:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789498656.629402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498656.629685:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864685312 00000100:00100000:2.0:1789498656.629701:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864685312 00000100:00100000:2.0:1789498656.629795:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:2.0:1789498656.629808:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14491:x1876424864685312:12345-192.168.201.20@tcp:101:stat.0 00010000:00010000:2.0:1789498656.629991:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498656.630021:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc1977c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a4fa expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630182:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630201:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630217:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630235:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630243:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630261:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630635:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630650:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 15 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630660:0:16313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630702:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 15 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.630721:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 15 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498656.630738:0:16313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16313:1876424885647360:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498656.631685:0:16313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498656.634303:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498656.634403:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864685568 00000100:00100000:3.0:1789498656.634417:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864685568 00000100:00100000:3.0:1789498656.634495:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:3.0:1789498656.634508:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+16:13743:x1876424864685568:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789498656.634986:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:13743:x1876424864685568:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 479us (696us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789498656.634995:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:2.0:1789498656.635250:0:16313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16313:1876424885647360:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498656.635298:0:16313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498656.638150:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498656.638249:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864685696 00000100:00100000:3.0:1789498656.638623:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864685696 00010000:00010000:3.0:1789498656.638680:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 17 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498656.638776:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498656.638807:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:2355:x1876424864685696:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498656.638830:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498656.638846:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 17 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.638864:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 17 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.638894:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19767 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4f3 expref: 17 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.638918:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:3.0:1789498656.638924:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.638937:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.638947:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498656.638984:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498656.639055:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+16:2355:x1876424864685696:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 251us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498656.639064:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00010000:00010000:2.0:1789498656.639215:0:16313:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639225:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498656.639319:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789498656.639325:0:16313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498656.639374:0:16313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639387:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639397:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639405:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639412:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639418:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498656.639423:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639431:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639440:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:2.0:1789498656.639443:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498656.639447:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639453:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19783 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639473:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639480:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639486:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639491:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcca00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498656.639494:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639500:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639506:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea82c62500) 00010000:00010000:2.0:1789498656.639508:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498656.639511:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639516:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc1978a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639561:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc1977c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4fa expref: 16 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639574:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4fa expref: 15 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.639591:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498656.639594:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498656.639596:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcc600, rc 0) 00000100:00100000:2.0:1789498656.639628:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14491:x1876424864685312:12345-192.168.201.20@tcp:101:stat.0 Request processed in 9824us (10244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498656.639635:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:0.0:1789498656.706445:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498656.706611:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864685952 00000100:00100000:2.0:1789498656.706627:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864685952 00000100:00100000:2.0:1789498656.706709:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:2.0:1789498656.706723:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14497:x1876424864685952:12345-192.168.201.20@tcp:36:truncate.0 00010000:00010000:2.0:1789498656.706814:0:14323:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498656.706860:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19791 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4fa expref: 15 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.706886:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498656.706893:0:14323:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498656.707317:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.707335:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.707346:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498656.707413:0:14323:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789498656.707445:0:14323:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086476142 reply state 00000000d52af88c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498656.707470:0:14323:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498656.707620:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:14497:x1876424864685952:12345-192.168.201.20@tcp:36:truncate.0 Request processed in 899us (1191us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789498656.707628:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00000020:00080000:2.0:1789498656.707635:0:14323:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498656.710815:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.710950:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.710961:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.710968:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadccc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498656.710974:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.710984:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.711005:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498656.711009:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498656.711015:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.711022:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19798 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498656.850247:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498656.850640:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864686080 00000100:00100000:2.0:1789498656.850675:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864686080 00000100:00100000:2.0:1789498656.850825:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1789498656.850838:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+16:14511:x1876424864686080:12345-192.168.201.20@tcp:101:stat.0 00010000:00010000:2.0:1789498656.850873:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498656.850900:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc1979f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a501 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.850986:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.851015:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.851030:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.851047:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.851055:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.851062:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.852917:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.852942:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.852954:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498656.853691:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789498656.853699:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498656.853730:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.853746:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855519:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855541:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855550:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855566:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498656.855572:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855581:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855602:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:2.0:1789498656.855606:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498656.855612:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855618:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc197a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855671:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855679:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855685:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855690:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcca00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498656.855692:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855699:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855706:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea82c62500) 00010000:00010000:2.0:1789498656.855709:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498656.855712:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855717:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855949:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc1979f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 18 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855966:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.855989:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498656.855991:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498656.855994:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcd400, rc 0) 00000100:00100000:2.0:1789498656.856600:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:14511:x1876424864686080:12345-192.168.201.20@tcp:101:stat.0 Request processed in 5760us (6363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498656.856611:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:0.0:1789498656.969457:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498656.969995:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864686336 00000100:00100000:2.0:1789498656.970010:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864686336 00000100:00100000:2.0:1789498656.970157:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:2.0:1789498656.970171:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:14521:x1876424864686336:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498656.970197:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498656.970224:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a508 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498656.970376:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789498656.970543:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a508 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.970559:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:2.0:1789498656.970562:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498656.970568:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a508 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498656.970585:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadccc00, rc 0) 00000100:00100000:2.0:1789498656.971325:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+18:14521:x1876424864686336:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1151us (1876us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789498656.971356:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:3.0:1789498656.975576:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498656.975743:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864686592 00000100:00100000:2.0:1789498656.975768:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864686592 00000100:00100000:2.0:1789498656.975859:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498656.975872:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+18:14521:x1876424864686592:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498656.976279:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14521:x1876424864686592:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 408us (718us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789498656.976288:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:1.0:1789498657.033700:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.033799:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864686848 00000100:00100000:2.0:1789498657.033812:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864686848 00000100:00100000:2.0:1789498657.033929:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:2.0:1789498657.033939:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14527:x1876424864686848:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498657.033969:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498657.033993:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197c9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a50f expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.034150:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.034165:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 20 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.034172:0:16313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.034207:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 20 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.034240:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 20 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498657.034252:0:16313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16313:1876424885647488:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498657.034383:0:16313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498657.036454:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.036545:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864686976 00000100:00100000:1.0:1789498657.036555:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864686976 00010000:00010000:1.0:1789498657.036598:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 21 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498657.036636:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1789498657.036644:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+21:2355:x1876424864686976:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498657.036673:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498657.036680:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 21 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.036692:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 21 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.036715:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498657.036719:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.036728:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.036735:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.036757:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498657.036806:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+21:2355:x1876424864686976:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 163us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.036812:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00010000:00010000:2.0:1789498657.037634:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a501 expref: 20 pid: 14325 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498657.037658:0:16313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16313:1876424885647488:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498657.037685:0:16313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.037694:0:16313:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.037699:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498657.037728:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789498657.037971:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197c9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 21 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.037984:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 20 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.037991:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498657.037999:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498657.038002:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcca00, rc 0) 00000100:00100000:2.0:1789498657.038058:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+20:14527:x1876424864686848:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4120us (4376us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789498657.038064:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498657.039899:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.039968:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864687232 00000100:00100000:1.0:1789498657.039981:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864687232 00000100:00100000:1.0:1789498657.040039:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:1.0:1789498657.040050:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+20:14527:x1876424864687232:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:1.0:1789498657.040472:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.040489:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.040515:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789498657.040573:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:1.0:1789498657.040603:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaa44939 reply state 0000000089121393 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498657.040613:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789498657.040740:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:14527:x1876424864687232:12345-192.168.201.20@tcp:36:bash.0 Request processed in 690us (847us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789498657.040748:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00000020:00080000:1.0:1789498657.040766:0:14324:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498657.042088:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.042143:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.042150:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.042157:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498657.042163:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.042173:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.042191:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498657.042194:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498657.042201:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.042208:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc197de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498657.044969:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.045050:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864687360 00000100:00100000:2.0:1789498657.045064:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864687360 00000100:00100000:2.0:1789498657.045170:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:2.0:1789498657.045189:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+22:14527:x1876424864687360:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498657.045222:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498657.045244:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a516 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.045366:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.045379:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 23 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.045386:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.045425:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 23 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.045437:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 23 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498657.045449:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885647616:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498657.045545:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498657.047055:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885647616:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498657.047125:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498657.047508:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.047655:0:16441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864687488 00000100:00100000:1.0:1789498657.047664:0:16441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864687488 00010000:00010000:1.0:1789498657.047706:0:16441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 24 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498657.047736:0:16441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:1.0:1789498657.047743:0:16441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+24:2355:x1876424864687488:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498657.047766:0:16441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498657.047772:0:16441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 24 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.047783:0:16441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 24 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.047804:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc197d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a50f expref: 24 pid: 16313 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.047843:0:16441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498657.047847:0:16441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.047855:0:16441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.047869:0:16441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.047891:0:16441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498657.047917:0:14325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.047934:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498657.047965:0:16441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:2355:x1876424864687488:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 221us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.047972:0:16441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000004:00200000:2.0:1789498657.048002:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789498657.048007:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498657.048036:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.048075:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a516 expref: 23 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.048126:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a516 expref: 22 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.048140:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:2.0:1789498657.048143:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498657.048146:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcd400, rc 0) 00000100:00100000:2.0:1789498657.048177:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+22:14527:x1876424864687360:12345-192.168.201.20@tcp:101:bash.0 Request processed in 2991us (3219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498657.048184:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:3.0:1789498657.050136:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.050292:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864687744 00000100:00100000:2.0:1789498657.050305:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864687744 00000100:00100000:2.0:1789498657.050376:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1789498657.050389:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+22:14527:x1876424864687744:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:2.0:1789498657.050702:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:14527:x1876424864687744:12345-192.168.201.20@tcp:35:bash.0 Request processed in 315us (609us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789498657.050711:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:0.0:1789498657.089435:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.089527:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864688000 00000100:00100000:2.0:1789498657.089543:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864688000 00000100:00100000:2.0:1789498657.089645:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:2.0:1789498657.089658:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:14537:x1876424864688000:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498657.089698:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498657.089727:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a51d expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498657.089858:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789498657.090019:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a51d expref: 25 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.090034:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:2.0:1789498657.090037:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498657.090042:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc197f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a51d expref: 25 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.090059:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadccc00, rc 0) 00000100:00100000:3.0:1789498657.090295:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+24:14537:x1876424864688000:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 639us (876us total) trans 8589934617 rc 301/301 00000100:00100000:3.0:1789498657.090304:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:3.0:1789498657.092036:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.092136:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864688128 00000100:00100000:1.0:1789498657.092149:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864688128 00000100:00100000:1.0:1789498657.092215:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:1.0:1789498657.092228:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+24:14537:x1876424864688128:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:1.0:1789498657.092339:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092359:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092370:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092383:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092405:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092409:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092706:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092714:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092719:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498657.092773:0:16313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092787:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092795:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092804:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092810:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.092814:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092821:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092843:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498657.092846:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.092852:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092860:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19801 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092875:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092881:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092885:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092887:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.092889:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092892:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092897:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498657.092898:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.092900:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092904:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19808 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092924:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092928:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092932:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092934:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.092936:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092939:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092943:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498657.092944:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.092946:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.092949:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1980f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498657.093031:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+24:14537:x1876424864688128:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 804us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.093039:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:0.0:1789498657.094738:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.094786:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864688384 00000100:00100000:2.0:1789498657.094798:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864688384 00000100:00100000:2.0:1789498657.094906:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498657.094919:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8700a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+24:14537:x1876424864688384:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498657.095242:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8700a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+25:14537:x1876424864688384:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 325us (511us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789498657.095251:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1789498657.112069:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.112132:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864688640 00000100:00100000:1.0:1789498657.112148:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864688640 00000100:00100000:1.0:1789498657.112234:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:1.0:1789498657.112412:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+25:14540:x1876424864688640:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498657.112448:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498657.112475:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19816 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a524 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.112589:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.112605:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.112617:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.112628:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.112633:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.112638:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113012:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc1982b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113022:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc1982b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113026:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc1982b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498657.113043:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789498657.113510:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113520:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113525:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113528:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.113532:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113539:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113550:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498657.113552:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.113556:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113561:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1981d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113573:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113576:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113588:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113592:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.113594:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113597:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113601:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498657.113603:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.113604:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113607:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19824 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113653:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19816 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a524 expref: 28 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113663:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc1982b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a524 expref: 27 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.113668:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498657.113670:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498657.113671:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00200, rc 0) 00000100:00100000:1.0:1789498657.113751:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14540:x1876424864688640:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1343us (1693us total) trans 8589934619 rc 0/0 00000100:00100000:1.0:1789498657.113770:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:3.0:1789498657.118365:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.118427:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498657.118583:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864689024 00000100:00100000:0.0:1789498657.118597:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864689024 00000100:00100000:0.0:1789498657.118677:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:0.0:1789498657.118689:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14540:x1876424864689024:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498657.118826:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864688768 00000100:00100000:1.0:1789498657.118832:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864688768 00000100:00100000:1.0:1789498657.118885:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1789498657.118893:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:2356:x1876424864688768:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498657.118907:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498657.118948:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc1982b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a524 expref: 29 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.118971:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498657.118977:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498657.119206:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14540:x1876424864689024:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 519us (777us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789498657.119216:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1789498657.119829:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:2356:x1876424864688768:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 933us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.119840:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1789498657.122438:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.122494:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864689152 00000100:00100000:1.0:1789498657.122508:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864689152 00000100:00100000:1.0:1789498657.122609:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:1.0:1789498657.122622:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14540:x1876424864689152:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:1.0:1789498657.122721:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122741:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122754:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122825:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122831:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122837:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122843:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.122848:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122857:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122872:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498657.122876:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498657.122883:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.122901:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19839 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498657.122994:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14540:x1876424864689152:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 375us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.123003:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00010000:00010000:3.0:1789498657.197175:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498657.259355:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.259529:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864689280 00000100:00100000:3.0:1789498657.259543:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864689280 00000100:00100000:3.0:1789498657.259623:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:3.0:1789498657.259636:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14559:x1876424864689280:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498657.259664:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498657.259693:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a52b expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.259788:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19847 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.259804:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19847 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.259819:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19847 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498657.259879:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789498657.259883:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498657.259902:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19847 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.259951:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a52b expref: 29 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.259976:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19847 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a52b expref: 28 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.259986:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:3.0:1789498657.259989:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498657.259994:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91600, rc 0) 00000100:00100000:3.0:1789498657.260065:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14559:x1876424864689280:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 430us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498657.260073:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:1.0:1789498657.261482:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885647744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498657.261557:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498657.261690:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885647744 00000100:00100000:0.0:1789498657.261701:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885647744 00000100:00100000:0.0:1789498657.261789:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789498657.261800:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885647744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498657.261854:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789498657.261991:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498657.265986:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885647744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4173us (4414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498657.266005:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498657.266871:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.266964:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864689664 00000100:00100000:2.0:1789498657.266979:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864689664 00000100:00100000:2.0:1789498657.267038:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:2.0:1789498657.267046:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14559:x1876424864689664:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498657.267514:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885647744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498657.267714:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14559:x1876424864689664:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 667us (848us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1789498657.267721:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:0.0:1789498657.270470:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.270607:0:16441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864689792 00000100:00100000:1.0:1789498657.270620:0:16441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864689792 00000100:00100000:1.0:1789498657.270706:0:16441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:1.0:1789498657.270721:0:16441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14559:x1876424864689792:12345-192.168.201.20@tcp:103:lfs.0 00010000:00010000:1.0:1789498657.270743:0:16441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789498657.270784:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc197ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a516 expref: 29 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.270815:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcda00/0x3a6cb1946bc1974b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4ec expref: 28 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.270982:0:16441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea9108c300) 00010000:00010000:1.0:1789498657.271001:0:16441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498657.271077:0:16441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14559:x1876424864689792:12345-192.168.201.20@tcp:103:lfs.0 Request processed in 359us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.271977:0:16441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:2.0:1789498657.274853:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.275040:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864689920 00000100:00100000:1.0:1789498657.275053:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864689920 00000100:00100000:1.0:1789498657.275200:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:1.0:1789498657.275215:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14559:x1876424864689920:12345-192.168.201.20@tcp:58:lfs.0 00010000:00010000:1.0:1789498657.275394:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.275417:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.275432:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498657.276452:0:14325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498657.276631:0:14325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789498657.276723:0:14325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789498657.276871:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14559:x1876424864689920:12345-192.168.201.20@tcp:58:lfs.0 Request processed in 1653us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.276884:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:3.0:1789498657.294884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.295057:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864690048 00000100:00100000:1.0:1789498657.295073:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864690048 00000100:00100000:1.0:1789498657.295179:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:1.0:1789498657.295192:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14561:x1876424864690048:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498657.295225:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498657.295482:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19855 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a532 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.295569:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.295583:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.295593:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.295606:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.295610:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.295634:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296509:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296522:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296529:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498657.296577:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789498657.296582:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498657.296602:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296612:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296620:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296625:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296630:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296633:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.296637:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296650:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296662:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498657.296664:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.296668:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296673:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1985c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296684:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296688:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296692:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296695:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.296697:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296700:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296703:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea83c9c900) 00010000:00010000:1.0:1789498657.296704:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.296706:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296716:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19863 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296759:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19855 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 29 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296775:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 28 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.296782:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498657.296785:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498657.296789:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00800, rc 0) 00000100:00100000:1.0:1789498657.296885:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14561:x1876424864690048:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1695us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.296895:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000040:00080000:1.0:1789498657.643432:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498657.643446:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498657.643545:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789498657.643555:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498657.643825:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba121880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14357:1876424885647872:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789498657.644036:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498657.653695:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.654083:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864690176 00000100:00100000:2.0:1789498657.654509:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864690176 00000100:00100000:2.0:1789498657.654583:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1789498657.654596:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14572:x1876424864690176:12345-192.168.201.20@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789498657.654894:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14572:x1876424864690176:12345-192.168.201.20@tcp:900:lhsmtool_posix.0 Request processed in 299us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498657.654904:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1789498657.655396:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba121880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14357:1876424885647872:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789498657.659392:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.659570:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864690304 00000100:00100000:1.0:1789498657.659586:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864690304 00000100:00100000:1.0:1789498657.659716:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:1.0:1789498657.659729:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14572:x1876424864690304:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789498657.659806:0:14325:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789498657.660399:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14572:x1876424864690304:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 669us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.660409:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1789498657.667388:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.667502:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864690432 00000100:00100000:1.0:1789498657.667515:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864690432 00000100:00100000:1.0:1789498657.667603:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:1.0:1789498657.667617:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14572:x1876424864690432:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789498657.667729:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667767:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667781:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667802:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667809:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667816:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667857:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667865:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667886:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498657.667951:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789498657.667957:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498657.667978:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.667992:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668000:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668007:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668014:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.668020:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668029:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668046:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea82c62800) 00010000:00010000:1.0:1789498657.668049:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.668056:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668064:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19871 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668128:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668135:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668142:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668148:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.668151:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668158:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668166:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98ea83c9c900) 00010000:00010000:1.0:1789498657.668168:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.668172:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668177:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19878 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668194:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668201:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668206:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668219:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498657.668223:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668230:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668238:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498657.668241:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498657.668244:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.668263:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1987f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498657.668362:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14572:x1876424864690432:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 Request processed in 748us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.668371:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:1.0:1789498657.673927:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.678723:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864690688 00000100:00100000:3.0:1789498657.679853:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864690688 00000100:00100000:3.0:1789498657.679940:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:3.0:1789498657.679948:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:14572:x1876424864690688:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498657.679972:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498657.679996:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19886 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a539 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680162:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680181:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680211:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498657.680223:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789498657.680571:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680580:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680588:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680594:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498657.680600:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680608:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680623:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:3.0:1789498657.680626:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498657.680632:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680638:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc1988d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680695:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19886 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a539 expref: 30 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680716:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea82c62800) 00010000:00010000:3.0:1789498657.680718:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498657.680723:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19886 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a539 expref: 30 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.680733:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90e00, rc 0) 00000100:00100000:3.0:1789498657.680976:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14572:x1876424864690688:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1026us (7064us total) trans 8589934622 rc 301/301 00000100:00100000:3.0:1789498657.680984:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:1.0:1789498657.683957:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.684036:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864690816 00000100:00100000:3.0:1789498657.684051:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864690816 00000100:00100000:3.0:1789498657.684343:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:3.0:1789498657.684355:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14572:x1876424864690816:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498657.684398:0:14324:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498657.684548:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14572:x1876424864690816:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 195us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498657.684555:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:0.0:1789498657.688064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.688556:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864691072 00000100:00100000:2.0:1789498657.688570:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864691072 00000100:00100000:2.0:1789498657.688641:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1789498657.688653:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14572:x1876424864691072:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498657.688684:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498657.688688:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789498657.688725:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19847 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a52b expref: 29 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.688818:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:2.0:1789498657.688892:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498657.688917:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc1989b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a540 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789498657.696974:0:14325:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1789498657.697007:0:14325:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789498657.697220:0:14325:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789498657.699003:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc198a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.699032:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc198a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.699049:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc198a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.700461:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc1989b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a540 expref: 31 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.700498:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc198a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a540 expref: 30 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.700509:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea83c9c900) 00010000:00010000:1.0:1789498657.700512:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498657.700518:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00a00, rc 0) 00000100:00100000:1.0:1789498657.700685:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+30:14572:x1876424864691072:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 12032us (12629us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789498657.700696:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:0.0:1789498657.708142:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.708229:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864691328 00000100:00100000:3.0:1789498657.708245:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864691328 00000100:00100000:3.0:1789498657.708345:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:3.0:1789498657.708357:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+30:14572:x1876424864691328:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498657.708442:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498657.708491:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc198a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a540 expref: 30 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.708550:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea83c9c900) 00010000:00010000:3.0:1789498657.708567:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498657.708602:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.708620:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.708633:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.708650:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.708658:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.708664:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709012:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709021:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709030:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709038:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498657.709044:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709062:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709074:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:3.0:1789498657.709078:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498657.709084:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709129:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc198b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709146:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709152:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709159:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709164:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498657.709167:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709173:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709180:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1dc56604 (ffff98ea9108ca00) 00010000:00010000:3.0:1789498657.709182:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498657.709185:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.709201:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc198b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1dc56604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498657.709329:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14572:x1876424864691328:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 972us (1238us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498657.709338:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:0.0:1789498657.713065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498657.713154:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864691456 00000100:00100000:0.0:1789498657.713171:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864691456 00000100:00100000:0.0:1789498657.713276:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:0.0:1789498657.713291:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14572:x1876424864691456:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498657.713334:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498657.713377:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc198be lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a547 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.713442:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.713462:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.713495:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.713641:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc198be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 31 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.713660:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 30 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.713669:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498657.713673:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789498657.713677:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4c00, rc 0) 00000100:00100000:0.0:1789498657.713754:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+30:14572:x1876424864691456:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 467us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498657.713762:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:2.0:1789498657.727546:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.727729:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864691712 00000100:00100000:3.0:1789498657.727756:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864691712 00000100:00100000:3.0:1789498657.727850:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:3.0:1789498657.727863:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+30:14572:x1876424864691712:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498657.727996:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.728023:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.728040:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498657.729447:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1789498657.729470:0:14324:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 557493378947ns, next at 558493375802ns, rc = 0 00000004:00010000:3.0:1789498657.729613:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffa49c7e reply state 0000000009168f56 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498657.729628:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498657.729933:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+32:14572:x1876424864691712:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 2067us (2396us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1789498657.729946:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:1.0:1789498657.742389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:2.0:1789498657.742774:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.742792:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.742802:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.742810:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498657.742816:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.742837:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.742858:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:2.0:1789498657.742862:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789498657.742868:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.742876:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc198cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498657.744603:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864691840 00000100:00100000:3.0:1789498657.744625:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864691840 00000100:00100000:3.0:1789498657.744815:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:3.0:1789498657.744841:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+31:14572:x1876424864691840:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498657.744882:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498657.744910:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a54e expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.744995:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 32 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.745014:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 32 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.745040:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:3.0:1789498657.745043:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498657.745048:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91800, rc 0) 00000100:00100000:3.0:1789498657.745167:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+32:14572:x1876424864691840:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 332us (2795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498657.747801:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:3.0:1789498657.762196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498657.762305:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864691968 00000100:00100000:0.0:1789498657.762324:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864691968 00000100:00080000:3.0:1789498657.762406:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498657.762437:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:0.0:1789498657.762450:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864691968:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789498657.763231:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864691968:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 777us (1048us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789498657.763243:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1789498657.773212:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.775623:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864692224 00000100:00100000:3.0:1789498657.775644:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864692224 00000100:00100000:3.0:1789498657.776344:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498657.776361:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+32:14572:x1876424864692224:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789498657.778236:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+33:14572:x1876424864692224:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 1865us (5018us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1789498657.778271:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498657.781766:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498657.781807:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864692480 00000100:00100000:0.0:1789498657.781821:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864692480 00000100:00100000:0.0:1789498657.781909:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:0.0:1789498657.781922:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+33:14572:x1876424864692480:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789498657.782115:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+33:14572:x1876424864692480:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 195us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498657.782123:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:2.0:1789498657.793332:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.793900:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864692608 00000100:00100000:1.0:1789498657.793915:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864692608 00000100:00100000:1.0:1789498657.793994:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:1.0:1789498657.794006:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+33:14572:x1876424864692608:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498657.794037:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498657.794070:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00c00/0x3a6cb1946bc198da lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a555 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.794193:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc198e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.794213:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc198e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.794261:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc198e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498657.794319:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498657.794344:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc198e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.794378:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00c00/0x3a6cb1946bc198da lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a555 expref: 35 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.794395:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc198e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a555 expref: 34 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.794402:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:1.0:1789498657.794405:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789498657.794409:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00600, rc 0) 00000100:00100000:1.0:1789498657.794482:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+34:14572:x1876424864692608:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 478us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.794490:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:3.0:1789498657.797963:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498657.798032:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864692736 00000100:00100000:1.0:1789498657.798047:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864692736 00000100:00100000:1.0:1789498657.798152:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1789498657.798169:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864692736:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498657.798194:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498657.798221:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a55c expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498657.798297:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa99521, blocks: 0x1 00010000:00010000:1.0:1789498657.798327:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=557s v=(0 0) 00010000:00010000:1.0:1789498657.798332:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498657.798344:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 7 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.798367:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 7 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498657.798383:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00a00, rc 0) 00000100:00100000:1.0:1789498657.798464:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2356:x1876424864692736:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 303us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.802180:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1789498657.804325:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.804366:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864692992 00000100:00100000:3.0:1789498657.804378:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864692992 00000100:00100000:3.0:1789498657.804443:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:3.0:1789498657.804455:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+34:14572:x1876424864692992:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789498657.804589:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+34:14572:x1876424864692992:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 135us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498657.804597:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:1.0:1789498657.811069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498657.811156:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864693120 00000100:00100000:0.0:1789498657.811176:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864693120 00000100:00100000:0.0:1789498657.811277:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1789498657.811290:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:14572:x1876424864693120:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498657.811316:0:15006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498657.811345:0:15006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a563 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.811397:0:15006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 8 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.811408:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498657.811413:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498657.811419:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 8 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.811466:0:15006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 8 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.811481:0:15006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 8 pid: 15008 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498657.811496:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15006:1876424885648000:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498657.811620:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84b16c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498657.824836:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15006:1876424885648000:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498657.825036:0:15006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 8 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.825075:0:15006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5600, rc 0) 00000100:00100000:0.0:1789498657.825222:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:14572:x1876424864693120:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 13933us (14171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498657.825233:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:1.0:1789498657.830603:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498657.830794:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864693248 00000100:00100000:0.0:1789498657.830807:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864693248 00010000:00010000:0.0:1789498657.830884:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 8 pid: 15008 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498657.830932:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498657.830945:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2355:x1876424864693248:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498657.830968:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498657.830999:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 8 pid: 15008 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.831012:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 8 pid: 15008 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.831037:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f804839/0x3a6cb1946bc198e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a55c expref: 8 pid: 15008 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.831073:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498657.831077:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498657.831085:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 7 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.831121:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 7 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498657.831168:0:14310:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 7 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498657.831187:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14310:1876424885648128:192.168.201.20@tcp:105: 00000100:00100000:0.0:1789498657.831295:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84b16c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498657.839383:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14310:1876424885648128:192.168.201.20@tcp:105: 00010000:00010000:3.0:1789498657.839423:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498657.839520:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2355:x1876424864693248:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 8576us (8931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498657.839534:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:2.0:1789498657.840428:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.840544:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864693376 00000100:00100000:3.0:1789498657.840556:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864693376 00002000:00100000:3.0:1789498657.840617:0:15012:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff98eaba8f7b80 x1876424864693376/t0(0) o4->68cd9685-a43a-48ba-9cd1-2238ca644a97@192.168.201.20@tcp:688/0 lens 504/0 e 0 to 0 dl 1789498668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789498657.840628:0:15012:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eaba8f7b80 with x1876424864693376 ext(0->8) 00002000:00010000:3.0:1789498657.840635:0:15012:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98eaba8f7b80 00000100:00100000:3.0:1789498657.840671:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:3.0:1789498657.840682:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2355:x1876424864693376:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789498657.841634:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:2355:x1876424864693376:12345-192.168.201.20@tcp:4:lhsmtool_posix.0 Request processed in 948us (1204us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789498657.841645:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00002000:00100000:3.0:1789498657.841655:0:15012:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff98eaba8f7b80 x1876424864693376/t8589934595(0) o4->68cd9685-a43a-48ba-9cd1-2238ca644a97@192.168.201.20@tcp:688/0 lens 504/448 e 0 to 0 dl 1789498668 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789498657.841665:0:15012:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98eaba8f7b80 with x1876424864693376 ext(0->8) 00002000:00010000:3.0:1789498657.841671:0:15012:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98eaba8f7b80 00000100:00100000:2.0:1789498657.846399:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.846663:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864693504 00000100:00100000:3.0:1789498657.846676:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864693504 00000100:00100000:3.0:1789498657.846754:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:3.0:1789498657.846763:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+34:14572:x1876424864693504:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789498657.902896:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:0.0:1789498657.902930:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000001:00080000:0.0:1789498657.902979:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:0.0:1789498657.902987:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789498657.903352:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885648256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789498657.903432:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498657.903664:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885648256 00000100:00100000:3.0:1789498657.903679:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885648256 00000100:00100000:3.0:1789498657.903757:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498657.903770:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885648256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789498657.904009:0:15007:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789498657.904015:0:15007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789498657 00002000:00010000:3.0:1789498657.904017:0:15007:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789498657.904020:0:15007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789498657 -> 1789498657 00002000:00010000:3.0:1789498657.904022:0:15007:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789498657.904302:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14572:x1876424864693504:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 Request processed in 57532us (57912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498657.904314:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:3.0:1789498657.904895:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876424885648256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1124us (1460us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789498657.904904:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1789498657.904969:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98ea8535ce00/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789498657.904977:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885648256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789498657.909980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498657.910262:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864693632 00000100:00100000:0.0:1789498657.910278:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864693632 00000100:00100000:0.0:1789498657.910362:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:0.0:1789498657.910376:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:2357:x1876424864693632:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789498657.975867:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:2357:x1876424864693632:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 Request processed in 65481us (65890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498657.975953:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000001:00080000:0.0:1789498657.976031:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1789498657.976064:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1789498657.976081:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000100:00100000:2.0:1789498657.980218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.980418:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864693888 00000100:00100000:3.0:1789498657.980433:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864693888 00000100:00100000:3.0:1789498657.980545:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:3.0:1789498657.980559:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+13:14572:x1876424864693888:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498657.980636:0:14323:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498657.980683:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc198e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a555 expref: 13 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.980835:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:3.0:1789498657.980842:0:14323:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498657.980888:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.980908:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498657.980921:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498657.981234:0:14323:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d0c9e86 reply state 000000003e6356d7 transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498657.981258:0:14323:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498657.981411:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14572:x1876424864693888:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 853us (1206us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1789498657.981422:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:0.0:1789498657.984216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498657.984480:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864694016 00000100:00100000:3.0:1789498657.984499:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864694016 00000100:00100000:3.0:1789498657.984591:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:3.0:1789498657.984606:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864694016:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789498657.985058:0:15007:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789498657.985081:0:15007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789498657 -> 1789498656 00002000:00010000:3.0:1789498657.985084:0:15007:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789498655 00002000:00010000:3.0:1789498657.985086:0:15007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789498657 -> 1789498656 00002000:00010000:3.0:1789498657.985114:0:15007:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789498657.985204:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2355:x1876424864694016:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 601us (1006us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789498657.985212:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00010000:00010000:2.0:1789498657.985645:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.985660:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.985670:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.985678:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498657.985684:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.985694:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.985726:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:2.0:1789498657.985730:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498657.985736:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.985744:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc198f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498657.990375:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498657.990457:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864694272 00000100:00100000:2.0:1789498657.990495:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864694272 00000100:00100000:2.0:1789498657.990597:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:2.0:1789498657.990613:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+13:14572:x1876424864694272:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789498657.990739:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.990764:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 13 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.990777:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.990827:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 13 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498657.990843:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 13 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498657.990860:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885648384:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498657.991011:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84f12000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498657.994446:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885648384:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498657.994503:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.000726:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.000850:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864694400 00000100:00100000:3.0:1789498658.000869:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864694400 00010000:00010000:3.0:1789498658.000956:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 14 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498658.001010:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:3.0:1789498658.001024:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864694400:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498658.001044:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498658.001148:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 14 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.001167:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 14 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.001200:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc198c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a547 expref: 14 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.001222:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:3.0:1789498658.001229:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.001269:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.001279:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.001324:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498658.001411:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+13:2355:x1876424864694400:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 390us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498658.001420:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00080000:2.0:1789498658.001517:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789498658.001657:0:14325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.001670:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.001729:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.001748:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.001756:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.001763:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.001767:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.001776:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.001795:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:1.0:1789498658.001799:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789498658.001803:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.001818:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc198fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.003552:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+12:14572:x1876424864694272:12345-192.168.201.20@tcp:55:lhsmtool_posix.0 Request processed in 12929us (13174us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789498658.003571:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:1.0:1789498658.006882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498658.007050:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864694528 00000100:00100000:2.0:1789498658.007070:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864694528 00000100:00100000:2.0:1789498658.007192:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1789498658.007213:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2356:x1876424864694528:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789498658.007306:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.007335:0:15006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 7 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.007347:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498658.007355:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498658.007362:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.007410:0:15006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 7 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.007427:0:15006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 7 pid: 15006 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498658.007444:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15006:1876424885648512:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498658.007565:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84f12000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498658.012176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.012255:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864694656 00000100:00100000:1.0:1789498658.012277:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864694656 00010000:00010000:1.0:1789498658.012344:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 8 pid: 15006 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.012409:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:1.0:1789498658.012441:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2355:x1876424864694656:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498658.012457:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498658.012486:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 8 pid: 15006 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.012502:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 8 pid: 15006 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.012529:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028baf00c/0x3a6cb1946bc198ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a563 expref: 8 pid: 15006 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.012548:0:14309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789498658.012552:0:14309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789498658.012558:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.012571:0:14309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.012596:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498658.012657:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2355:x1876424864694656:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 228us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498658.012666:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:3.0:1789498658.014178:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15006:1876424885648512:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498658.014218:0:15006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.014236:0:15006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.014252:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.014767:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.014778:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.015601:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.015615:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498658.015621:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.015632:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.015656:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.015665:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19904 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498658.016614:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864694528:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 Request processed in 9401us (9793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498658.016626:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:0.0:1789498658.023895:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.023965:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864694912 00000100:00100000:3.0:1789498658.023976:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864694912 00000100:00100000:3.0:1789498658.024469:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:3.0:1789498658.024480:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+12:14572:x1876424864694912:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789498658.024573:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.024600:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.024612:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.024948:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.024957:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 13 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.024965:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.025004:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 13 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.025019:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 13 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498658.025033:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885648640:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498658.025154:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789498658.030300:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885648640:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498658.030340:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.038177:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.038269:0:16441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864695040 00000100:00100000:0.0:1789498658.038285:0:16441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864695040 00010000:00010000:0.0:1789498658.038344:0:16441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 14 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.038392:0:16441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:0.0:1789498658.038405:0:16441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864695040:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498658.038426:0:16441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498658.038435:0:16441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 14 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.038452:0:16441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 14 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.038482:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc198d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a54e expref: 14 pid: 16313 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.038505:0:16441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498658.038512:0:16441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.038523:0:16441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.038613:0:16441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.038654:0:16441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498658.039006:0:16441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+13:2356:x1876424864695040:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 601us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498658.039016:0:16441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00010000:00010000:0.0:1789498658.039061:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.039071:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498658.039404:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:0.0:1789498658.041469:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:0.0:1789498658.041615:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:0.0:1789498658.041998:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14324:1876424885648768:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789498658.042087:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498658.042188:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab9d2f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498658.042227:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885648768 00000100:00100000:2.0:1789498658.042263:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885648768 00000100:00100000:2.0:1789498658.043013:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498658.043027:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14324:x1876424885648768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789498658.043190:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14324:x1876424885648768:12345-0@lo:1000:mdt00_001.0 Request processed in 165us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498658.043208:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498658.043238:0:14324:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934596 gen 2 00000004:00080000:0.0:1789498658.043289:0:14324:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98ea8535ce00, transno 8589934596 00000100:00100000:0.0:1789498658.043322:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14324:1876424885648768:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789498658.044492:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:0.0:1789498658.044610:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14324:1876424885648896:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789498658.044747:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498658.044792:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab9d2f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789498658.045819:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885648896 00000100:00100000:3.0:1789498658.045844:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885648896 00000100:00100000:3.0:1789498658.045920:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498658.045931:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14324:x1876424885648896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789498658.046251:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1876424885648896:12345-0@lo:1000:mdt00_001.0 Request processed in 311us (1494us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789498658.046262:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498658.046327:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14324:1876424885648896:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789498658.046412:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046427:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046435:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046444:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498658.046450:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046460:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046482:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498658.046486:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498658.046493:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046500:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19912 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046568:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046576:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046582:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046598:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498658.046602:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046608:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046618:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:0.0:1789498658.046621:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789498658.046625:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046632:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc1984e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046661:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046680:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046691:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046755:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.046776:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 16 pid: 14323 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.046808:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885649024:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498658.047137:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab9d2f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789498658.049597:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885649024:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498658.049631:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498658.052832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498658.052908:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864695168 00000100:00100000:2.0:1789498658.052919:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864695168 00010000:00010000:2.0:1789498658.052961:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 17 pid: 14323 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498658.053006:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498658.053014:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:2355:x1876424864695168:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498658.053026:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498658.053031:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 17 pid: 14323 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.053041:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 17 pid: 14323 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.053059:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1986a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a532 expref: 17 pid: 14323 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.053071:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498658.053075:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.053083:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.053140:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.053182:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498658.053224:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+16:2355:x1876424864695168:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 211us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498658.053229:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00010000:00010000:1.0:1789498658.056287:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056503:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056516:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056521:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056526:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056530:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.056533:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056538:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056551:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498658.056554:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498658.056557:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056562:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19919 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056571:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056594:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056598:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056600:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.056602:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056605:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056610:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498658.056611:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789498658.056613:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.056616:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc1990b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.056892:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14572:x1876424864694912:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 32409us (33003us total) trans 8589934631 rc 0/0 00000100:00100000:1.0:1789498658.056902:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000020:00080000:1.0:1789498658.056909:0:14324:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789498658.060840:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498658.060850:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498658.060910:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789498658.060916:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498658.067234:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498658.068939:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864695424 00000100:00100000:2.0:1789498658.068960:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864695424 00000100:00100000:2.0:1789498658.069036:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:2.0:1789498658.069052:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14572:x1876424864695424:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789498658.070262:0:14326:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789498658.070618:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:2.0:1789498658.070678:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.070698:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.070711:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.070720:0:14326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.070726:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.070745:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.070768:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498658.070883:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498658.070899:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.070909:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498658.070914:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.070923:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498658.070940:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:14572:x1876424864695424:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 1888us (3716us total) trans 8589934633 rc 0/0 00010000:00010000:3.0:1789498658.070941:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98ea82c62300) 00010000:00010000:3.0:1789498658.070949:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789498658.070956:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498658.070967:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00010000:00010000:3.0:1789498658.070969:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19920 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789498658.070981:0:14326:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789498658.071016:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498658.071018:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498658.071020:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498658.149031:0:16594:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498658.149044:0:16594:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498658.149076:0:16594:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789498658.149082:0:16594:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498658.221918:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498658.280761:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498658.280876:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864695680 00000100:00100000:2.0:1789498658.280897:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864695680 00000100:00100000:2.0:1789498658.281007:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:2.0:1789498658.281021:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+17:14582:x1876424864695680:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498658.281054:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498658.281083:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a56a expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498658.281256:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789498658.281549:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19927 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a56a expref: 19 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.281586:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:3.0:1789498658.281591:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498658.281600:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a56a expref: 19 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.281622:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadccc00, rc 0) 00000100:00100000:3.0:1789498658.281703:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+18:14582:x1876424864695680:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 685us (957us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1789498658.281712:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:0.0:1789498658.289166:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.289388:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864695808 00000100:00100000:1.0:1789498658.289406:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864695808 00000100:00100000:1.0:1789498658.289476:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:1.0:1789498658.289486:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+18:14582:x1876424864695808:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:1.0:1789498658.289657:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.289678:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.289694:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.289712:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.289721:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.289730:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.289989:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.289999:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.290006:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498658.290047:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.290060:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.290077:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.290085:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.290117:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.290122:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.290131:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.290144:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498658.290147:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498658.290153:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291698:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19935 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291725:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291734:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291743:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291751:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.291769:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291779:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291800:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498658.291805:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498658.291810:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291818:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1993c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291859:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291867:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291876:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291886:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.291891:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291900:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291917:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498658.291921:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498658.291931:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.291938:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19943 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.292082:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+18:14582:x1876424864695808:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 2589us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498658.292124:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:2.0:1789498658.297754:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.300472:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864696064 00000100:00100000:3.0:1789498658.300577:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864696064 00000100:00100000:3.0:1789498658.300729:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498658.300743:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+18:14582:x1876424864696064:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498658.301196:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14582:x1876424864696064:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 453us (3458us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1789498658.301205:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1789498658.355426:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.355834:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864696320 00000100:00100000:1.0:1789498658.355850:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864696320 00000100:00100000:1.0:1789498658.355929:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:1.0:1789498658.355942:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14585:x1876424864696320:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498658.355984:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498658.356017:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1994a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a571 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.357106:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.357680:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.357698:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.357722:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.357731:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.357758:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.359315:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.359338:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.359351:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498658.359367:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:1.0:1789498658.359955:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.359966:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.359975:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.359982:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.359987:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.359996:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360010:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498658.360013:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498658.360028:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360034:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc19951 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360051:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360056:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360061:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360067:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.360069:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360074:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360082:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498658.360084:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498658.360087:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360115:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19958 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360770:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1994a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 22 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360802:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 21 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.360811:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498658.360814:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498658.360817:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01c00, rc 0) 00000100:00100000:1.0:1789498658.360911:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+21:14585:x1876424864696320:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 4971us (5499us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1789498658.360922:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:3.0:1789498658.365055:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.366352:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864696448 00000100:00100000:0.0:1789498658.366371:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864696448 00000100:00100000:0.0:1789498658.366455:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:0.0:1789498658.366468:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+21:14585:x1876424864696448:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:0.0:1789498658.366563:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366584:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366600:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366640:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366647:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366671:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366677:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498658.366683:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366692:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366705:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:0.0:1789498658.366708:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789498658.366714:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.366721:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc1996d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.366819:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+21:14585:x1876424864696448:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 354us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498658.366828:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1789498658.369615:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.369697:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864696704 00000100:00100000:0.0:1789498658.369711:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864696704 00000100:00100000:0.0:1789498658.369784:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498658.369797:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea87009850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+21:14585:x1876424864696704:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1789498658.370266:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea87009850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+22:14585:x1876424864696704:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 470us (664us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1789498658.370275:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498658.411375:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.411945:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864696960 00000100:00100000:3.0:1789498658.411978:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864696960 00000100:00100000:3.0:1789498658.412060:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:3.0:1789498658.412072:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+22:12107:x1876424864696960:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498658.412157:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498658.412188:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc19974 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a578 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.412366:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.412386:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 23 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.412397:0:16313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.412444:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 23 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.412461:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 23 pid: 14325 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498658.412477:0:16313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16313:1876424885649152:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498658.412624:0:16313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498658.417209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.417759:0:16313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16313:1876424885649152:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498658.417798:0:16313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.418131:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864697088 00000100:00100000:0.0:1789498658.418141:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864697088 00010000:00010000:0.0:1789498658.418195:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 24 pid: 14325 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.418250:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:0.0:1789498658.418315:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+24:2355:x1876424864697088:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498658.418336:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498658.418344:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 24 pid: 14325 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.418356:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 24 pid: 14325 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.418379:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1995f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a571 expref: 24 pid: 14325 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.418395:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:0.0:1789498658.418399:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.418411:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.418420:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.418456:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498658.418545:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:2355:x1876424864697088:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 285us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498658.418553:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00010000:00010000:3.0:1789498658.418728:0:16313:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.418738:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498658.418763:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:3.0:1789498658.419079:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91c00/0x3a6cb1946bc19974 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 24 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.419129:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 23 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.419139:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:3.0:1789498658.419142:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789498658.419145:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90a00, rc 0) 00000100:00100000:3.0:1789498658.419186:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:12107:x1876424864696960:12345-192.168.201.20@tcp:101:bash.0 Request processed in 7117us (7826us total) trans 8589934638 rc 0/0 00000100:00100000:3.0:1789498658.419194:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:2.0:1789498658.422002:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.422344:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864697344 00000100:00100000:0.0:1789498658.422360:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864697344 00000100:00100000:0.0:1789498658.422770:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:0.0:1789498658.422784:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:12107:x1876424864697344:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:0.0:1789498658.423227:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.423264:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.423279:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789498658.423348:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:0.0:1789498658.423377:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d61993a2 reply state 0000000041312bbb transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.423389:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789498658.423482:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:0.0:1789498658.423654:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:12107:x1876424864697344:12345-192.168.201.20@tcp:36:bash.0 Request processed in 871us (1665us total) trans 8589934641 rc 0/0 00000100:00100000:0.0:1789498658.423663:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000020:00080000:0.0:1789498658.423670:0:14324:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789498658.425951:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.426253:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864697472 00000100:00100000:1.0:1789498658.426268:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864697472 00000100:00100000:1.0:1789498658.426354:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:1.0:1789498658.426368:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:12107:x1876424864697472:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498658.426480:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498658.427360:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19990 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a57f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.427479:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19990 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a57f expref: 28 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.427510:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19990 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a57f expref: 28 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.427543:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498658.427546:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498658.427569:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01800, rc 0) 00000100:00100000:1.0:1789498658.427667:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:12107:x1876424864697472:12345-192.168.201.20@tcp:101:bash.0 Request processed in 1301us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498658.427676:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00010000:00010000:2.0:1789498658.427802:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.427813:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.427821:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.427839:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498658.427845:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.427854:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.427868:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498658.427870:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498658.427875:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.427881:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19989 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.431311:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.431413:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864697600 00000100:00100000:3.0:1789498658.431426:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864697600 00000100:00100000:3.0:1789498658.431547:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:3.0:1789498658.431561:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:12107:x1876424864697600:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498658.431591:0:15007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498658.431633:0:15007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a586 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498658.431698:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 9, mtime: 0x6aa99520, atime: 0x6aa9951f, ctime: 0x6aa99520, blocks: 0xb 00010000:00010000:3.0:1789498658.431729:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1789498658.431734:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498658.431745:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.431769:0:15007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.431785:0:15007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91c00, rc 0) 00000100:00100000:3.0:1789498658.431870:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:12107:x1876424864697600:12345-192.168.201.20@tcp:101:bash.0 Request processed in 312us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498658.431878:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:3.0:1789498658.434701:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.434981:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864697728 00000100:00100000:0.0:1789498658.434998:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864697728 00002000:00010000:0.0:1789498658.435069:0:15014:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (0->18446744073709551615) 00002000:00100000:0.0:1789498658.435075:0:15014:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98ea8535df80 with x1876424864697728 ext(0->18446744073709551615) 00002000:00010000:0.0:1789498658.435898:0:15014:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98ea8535df80. 00000100:00100000:0.0:1789498658.435948:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:0.0:1789498658.435962:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2356:x1876424864697728:12345-192.168.201.20@tcp:10:bash.0 00002000:00010000:0.0:1789498658.436477:0:15014:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789498658.436482:0:15014:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789498656 -> 1789498658 00002000:00010000:0.0:1789498658.436485:0:15014:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1789498655 -> 1789498655 00002000:00010000:0.0:1789498658.436488:0:15014:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789498656 -> 1789498658 00002000:00010000:0.0:1789498658.436490:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789498658.436596:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2356:x1876424864697728:12345-192.168.201.20@tcp:10:bash.0 Request processed in 635us (1907us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789498658.436612:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00002000:00010000:0.0:1789498658.436619:0:15014:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (0->18446744073709551615) 00002000:00100000:0.0:1789498658.436622:0:15014:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98ea8535df80 with x1876424864697728 ext(0->18446744073709551615) 00002000:00010000:0.0:1789498658.436628:0:15014:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98ea8535df80. 00000100:00100000:2.0:1789498658.538876:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.539148:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864697984 00000100:00100000:1.0:1789498658.539163:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864697984 00000100:00100000:1.0:1789498658.539244:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:1.0:1789498658.539268:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:14599:x1876424864697984:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498658.539300:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498658.539327:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1999e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a58d expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.539475:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00c00/0x3a6cb1946bc199a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.539652:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00c00/0x3a6cb1946bc199a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.539669:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00c00/0x3a6cb1946bc199a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498658.539682:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789498658.540011:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1999e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a58d expref: 30 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.540037:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00c00/0x3a6cb1946bc199a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a58d expref: 29 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.540048:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498658.540072:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789498658.540078:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00c00, rc 0) 00000100:00100000:1.0:1789498658.540227:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14599:x1876424864697984:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 973us (1368us total) trans 8589934642 rc 0/0 00000100:00100000:1.0:1789498658.540245:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:3.0:1789498658.548501:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.549555:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864698112 00000100:00100000:0.0:1789498658.549574:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864698112 00000100:00100000:0.0:1789498658.549674:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:0.0:1789498658.549687:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14599:x1876424864698112:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:0.0:1789498658.550645:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.550677:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.550693:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.550749:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.550759:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.550766:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551378:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551393:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551401:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498658.551466:0:16313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551480:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551488:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551497:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551504:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498658.551510:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551530:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551546:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:0.0:1789498658.551550:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498658.551556:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551563:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551579:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551585:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551591:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551596:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498658.551599:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551605:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551612:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea84ebfd00) 00010000:00010000:0.0:1789498658.551614:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498658.551617:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551632:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551651:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551656:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551661:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551666:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498658.551669:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551675:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551682:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:0.0:1789498658.551685:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498658.551688:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.551693:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.552169:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14599:x1876424864698112:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 2476us (3676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498658.552183:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:3.0:1789498658.601420:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.601984:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864698368 00000100:00100000:0.0:1789498658.601998:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864698368 00000100:00100000:0.0:1789498658.602192:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:0.0:1789498658.602205:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+29:14602:x1876424864698368:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498658.602244:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498658.602287:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a594 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.602393:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.602412:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.602427:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.602445:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.602453:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.602461:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603535:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcdc00/0x3a6cb1946bc199dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603555:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcdc00/0x3a6cb1946bc199dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603567:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcdc00/0x3a6cb1946bc199dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498658.603580:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498658.603734:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603743:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603767:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603774:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498658.603779:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603787:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603812:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:2.0:1789498658.603816:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498658.603822:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603829:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc199cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603846:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603852:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603857:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603862:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498658.603865:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603882:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603890:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea84ebfd00) 00010000:00010000:2.0:1789498658.603893:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498658.603896:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603901:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc199d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603958:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5800/0x3a6cb1946bc199c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a594 expref: 32 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603975:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcdc00/0x3a6cb1946bc199dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a594 expref: 31 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.603983:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498658.603985:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789498658.603987:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcdc00, rc 0) 00000100:00100000:2.0:1789498658.604083:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+31:14602:x1876424864698368:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1880us (2678us total) trans 8589934643 rc 0/0 00000100:00100000:2.0:1789498658.604138:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:3.0:1789498658.606977:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.608069:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864698496 00000100:00100000:1.0:1789498658.608251:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864698496 00000100:00100000:1.0:1789498658.608356:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:1.0:1789498658.608368:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+31:14602:x1876424864698496:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:1.0:1789498658.608475:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.608501:0:14323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 31 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.608514:0:14323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.608560:0:14323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 31 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.608577:0:14323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 31 pid: 16313 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.608597:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14323:1876424885649280:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498658.608737:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa055f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789498658.612742:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.612792:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864698752 00000100:00100000:1.0:1789498658.612832:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864698752 00000100:00100000:1.0:1789498658.612905:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:1.0:1789498658.612916:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+32:13743:x1876424864698752:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789498658.613413:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+33:13743:x1876424864698752:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 496us (692us total) trans 8589934644 rc 0/0 00000100:00100000:1.0:1789498658.613422:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1789498658.613931:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14323:1876424885649280:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498658.613965:0:14323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.620683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498658.621203:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864698880 00000100:00100000:2.0:1789498658.621249:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864698880 00010000:00010000:2.0:1789498658.621420:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 33 pid: 16313 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498658.621508:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1789498658.621521:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+33:2356:x1876424864698880:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498658.621545:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498658.621554:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 33 pid: 16313 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.621571:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 33 pid: 16313 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.621603:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc1997b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a578 expref: 33 pid: 16313 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.621633:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498658.621640:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.621654:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.621665:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.621710:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498658.621816:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+32:2356:x1876424864698880:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 297us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498658.621838:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00010000:00010000:1.0:1789498658.622077:0:14323:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.622112:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.622162:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.622171:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.622179:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.622187:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498658.622192:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.622201:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.622213:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498658.622216:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498658.622228:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.622247:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc199eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.622616:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+31:14602:x1876424864698496:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 14249us (15652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498658.622629:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:1.0:1789498658.626451:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.626604:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864699136 00000100:00100000:3.0:1789498658.626619:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864699136 00000100:00100000:3.0:1789498658.626698:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:3.0:1789498658.626713:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+31:14602:x1876424864699136:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1789498658.627164:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+32:14602:x1876424864699136:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 454us (732us total) trans 8589934645 rc 0/0 00000100:00100000:3.0:1789498658.627172:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:0.0:1789498658.715350:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.715478:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864699392 00000100:00100000:3.0:1789498658.715492:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864699392 00000100:00100000:3.0:1789498658.715624:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:3.0:1789498658.715639:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+32:14613:x1876424864699392:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:3.0:1789498658.715681:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498658.715714:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc199f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a59b expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.715851:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.715869:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.715885:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.715902:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.715910:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.715917:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716318:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19a07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716330:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19a07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716352:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19a07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498658.716366:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:3.0:1789498658.716515:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716524:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716532:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716538:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498658.716543:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716552:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716571:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:3.0:1789498658.716575:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498658.716581:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716588:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90a00/0x3a6cb1946bc199f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716607:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716611:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716621:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716624:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498658.716626:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716630:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716635:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea9108c100) 00010000:00010000:3.0:1789498658.716637:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498658.716639:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716643:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19a00 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716706:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc199f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a59b expref: 35 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716716:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19a07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a59b expref: 34 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.716722:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:3.0:1789498658.716723:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498658.716725:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91200, rc 0) 00000100:00100000:3.0:1789498658.716819:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+34:14613:x1876424864699392:12345-192.168.201.20@tcp:101:cat.0 Request processed in 1185us (1735us total) trans 8589934646 rc 0/0 00000100:00100000:3.0:1789498658.716834:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:3.0:1789498658.724004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.724138:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864699648 00000100:00100000:1.0:1789498658.724157:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864699648 00000100:00100000:1.0:1789498658.724265:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:1.0:1789498658.724279:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+34:14613:x1876424864699648:12345-192.168.201.20@tcp:35:cat.0 00000100:00100000:1.0:1789498658.724668:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+35:14613:x1876424864699648:12345-192.168.201.20@tcp:35:cat.0 Request processed in 391us (681us total) trans 8589934647 rc 0/0 00000100:00100000:1.0:1789498658.724677:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:1.0:1789498658.742341:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.742529:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864699904 00000100:00100000:0.0:1789498658.742543:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864699904 00000100:00100000:0.0:1789498658.742625:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:0.0:1789498658.742637:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+35:14614:x1876424864699904:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1789498658.742869:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789498658.742909:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91200/0x3a6cb1946bc19a07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a59b expref: 35 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.742943:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcdc00/0x3a6cb1946bc199dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a594 expref: 34 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.742958:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19990 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a57f expref: 33 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.742969:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:0.0:1789498658.742984:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498658.743010:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.743027:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.743038:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.743055:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.743061:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.743068:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.743716:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.743932:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.743942:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498658.745369:0:14325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3, 64 off8408 00000004:00080000:0.0:1789498658.745387:0:14325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 558509295750ns, next at 559509291415ns, rc = 0 00010000:00010000:0.0:1789498658.745490:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745510:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745522:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745533:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745540:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745546:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745583:0:14325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498658.745643:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745662:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745670:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745676:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498658.745682:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745692:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.745706:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea84ebf300) 00010000:00010000:0.0:1789498658.745709:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789498658.745715:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.746021:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498658.746031:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.746038:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498658.746042:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.746050:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.746060:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98ea84ebf300) 00010000:00010000:3.0:1789498658.746063:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789498658.746066:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.746072:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19a2a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.746118:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498658.746120:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498658.746122:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498658.746185:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19a23 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.746215:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.746222:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.746239:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.746246:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498658.746323:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.746332:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.746342:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:0.0:1789498658.746344:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498658.746347:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498658.746353:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5200/0x3a6cb1946bc19a15 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498658.746364:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000142d9aa6 reply state 00000000d416ba56 transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.746374:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498658.746498:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+34:14614:x1876424864699904:12345-192.168.201.20@tcp:36:rm.0 Request processed in 3859us (4168us total) trans 8589934648 rc 0/0 00000100:00100000:0.0:1789498658.746509:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00010000:00010000:2.0:1789498658.751832:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.751859:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.751868:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.751875:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498658.751881:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.751890:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.751910:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea84ebff00) 00010000:00010000:2.0:1789498658.751913:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498658.751920:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.751926:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19a1c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498658.794154:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498658.794434:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864700160 00000100:00100000:2.0:1789498658.794448:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864700160 00000100:00100000:2.0:1789498658.794534:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:2.0:1789498658.794548:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+33:14620:x1876424864700160:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498658.794584:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498658.794637:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a31 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5a2 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.794943:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.794963:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.794978:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.794995:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.795003:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.795010:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797570:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797599:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797613:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498658.797627:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789498658.797673:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797704:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797712:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797720:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498658.797725:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797735:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797751:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:2.0:1789498658.797754:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498658.797761:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.797768:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19a38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498658.797788:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086183881 reply state 000000005b7884eb transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498658.797941:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789498658.797992:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a31 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 36 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.798012:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 35 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.798032:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:2.0:1789498658.798035:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789498658.798038:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcc800, rc 0) 00000100:00100000:2.0:1789498658.798363:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+36:14620:x1876424864700160:12345-192.168.201.20@tcp:101:bash.0 Request processed in 3816us (4281us total) trans 8589934649 rc 0/0 00000100:00100000:2.0:1789498658.798375:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:3.0:1789498658.802856:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.803056:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864700288 00000100:00100000:1.0:1789498658.803071:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864700288 00000100:00100000:1.0:1789498658.803182:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1789498658.803194:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+36:14620:x1876424864700288:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1789498658.803237:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498658.803281:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19a54 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.803385:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.803431:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.803448:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498658.803521:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789498658.803527:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498658.803556:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.803570:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.803604:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19a54 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 38 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.803625:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 37 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498658.803635:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:1.0:1789498658.803638:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498658.803644:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01800, rc 0) 00000100:00100000:1.0:1789498658.803742:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+37:14620:x1876424864700288:12345-192.168.201.20@tcp:101:bash.0 Request processed in 550us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498658.803750:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00010000:00010000:2.0:1789498658.805200:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.805219:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.805226:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498658.808147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.808328:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864700544 00000100:00100000:1.0:1789498658.808344:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864700544 00000100:00100000:1.0:1789498658.808436:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:1.0:1789498658.808471:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+37:14620:x1876424864700544:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:1.0:1789498658.809053:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+38:14620:x1876424864700544:12345-192.168.201.20@tcp:35:bash.0 Request processed in 583us (979us total) trans 8589934650 rc 0/0 00000100:00100000:1.0:1789498658.809062:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00010000:00010000:2.0:1789498658.811386:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498658.811396:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.811410:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.811432:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea82c62500) 00010000:00010000:2.0:1789498658.811436:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498658.811442:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.811450:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498658.908990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.909186:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864700800 00000100:00100000:3.0:1789498658.909198:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864700800 00000100:00100000:3.0:1789498658.909398:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1789498658.909413:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+37:14633:x1876424864700800:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498658.909476:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498658.909512:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19a62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5b0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.909686:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.909706:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.909722:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498658.909734:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789498658.909918:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19a62 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b0 expref: 40 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.909941:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b0 expref: 39 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.909949:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:3.0:1789498658.909952:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498658.909955:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91600, rc 0) 00000100:00100000:3.0:1789498658.910037:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+39:14633:x1876424864700800:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 629us (1059us total) trans 8589934651 rc 0/0 00000100:00100000:3.0:1789498658.910043:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:0.0:1789498658.915570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498658.915627:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498658.915738:0:16441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864701056 00000100:00100000:3.0:1789498658.915754:0:16441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864701056 00000100:00100000:3.0:1789498658.915851:0:16441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1789498658.915889:0:16441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+39:2356:x1876424864701056:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498658.915917:0:16441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498658.915952:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b0 expref: 39 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498658.915981:0:16441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:3.0:1789498658.915988:0:16441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498658.916070:0:16441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+38:2356:x1876424864701056:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 185us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498658.916078:0:16441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:2.0:1789498658.916431:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864700928 00000100:00100000:2.0:1789498658.916437:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864700928 00000100:00100000:2.0:1789498658.916516:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:2.0:1789498658.916525:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+38:14633:x1876424864700928:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:2.0:1789498658.916616:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916646:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916659:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916701:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916709:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916727:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916734:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498658.916740:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916748:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916759:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:2.0:1789498658.916773:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498658.916779:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498658.916786:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498658.916851:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+38:14633:x1876424864700928:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 327us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498658.916858:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:0.0:1789498658.918937:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498658.919063:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864701312 00000100:00100000:1.0:1789498658.919075:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864701312 00000100:00100000:1.0:1789498658.919179:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:1.0:1789498658.919191:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+38:14633:x1876424864701312:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498658.919531:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+39:14633:x1876424864701312:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 342us (607us total) trans 8589934652 rc 0/0 00000100:00100000:1.0:1789498658.919540:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:0.0:1789498659.001447:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.001584:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864701568 00000100:00100000:2.0:1789498659.001599:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864701568 00000100:00100000:2.0:1789498659.001674:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:2.0:1789498659.001687:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+39:14643:x1876424864701568:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498659.001730:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498659.001755:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a7e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5b7 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.001895:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.001909:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 40 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.001915:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 40 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.001921:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.001978:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 40 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.001990:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 40 pid: 14323 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.002002:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885649408:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498659.002162:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 40 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.002172:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 40 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.002180:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885649536:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498659.002211:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea814869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498659.005862:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.005908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.006039:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864701696 00000100:00100000:1.0:1789498659.006051:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864701696 00010000:00010000:1.0:1789498659.006161:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 41 pid: 14323 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498659.006213:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864701824 00000100:00100000:1.0:1789498659.006217:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864701824 00010000:00010000:1.0:1789498659.006244:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 42 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498659.006279:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:1.0:1789498659.006292:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:2355:x1876424864701696:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498659.006314:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498659.006323:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 42 pid: 14323 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006368:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 42 pid: 14323 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006400:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:1.0:1789498659.006406:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006415:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006420:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498659.006484:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:2355:x1876424864701696:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 195us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498659.006489:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:1.0:1789498659.006506:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:1.0:1789498659.006510:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:2355:x1876424864701824:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498659.006517:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498659.006522:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 41 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006532:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 41 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006543:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:1.0:1789498659.006546:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006567:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006579:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.006606:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498659.006621:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:2355:x1876424864701824:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 110us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498659.006625:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00010000:00010000:2.0:1789498659.008972:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19a5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a9 expref: 40 pid: 14323 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.009010:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885649408:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498659.009028:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19a46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5a2 expref: 39 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.009039:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1876424885649536:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498659.009081:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.009184:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.009192:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498659.009238:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789498659.010500:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19a7e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 40 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.010532:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 39 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.010542:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:2.0:1789498659.010546:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498659.010551:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcd800, rc 0) 00000100:00100000:2.0:1789498659.010649:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+39:14643:x1876424864701568:12345-192.168.201.20@tcp:101:bash.0 Request processed in 8963us (9219us total) trans 8589934653 rc 0/0 00000100:00100000:2.0:1789498659.010659:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:0.0:1789498659.012799:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.012974:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864702080 00000100:00100000:3.0:1789498659.012991:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864702080 00000100:00100000:3.0:1789498659.013078:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:3.0:1789498659.013125:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+39:14643:x1876424864702080:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:3.0:1789498659.013775:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.013800:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.013815:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498659.013886:0:14325:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934654 00000004:00010000:3.0:1789498659.013914:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6e68e90 reply state 0000000036e0419a transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.013925:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498659.014050:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14643:x1876424864702080:12345-192.168.201.20@tcp:36:bash.0 Request processed in 961us (1271us total) trans 8589934655 rc 0/0 00000100:00100000:3.0:1789498659.014076:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000020:00080000:3.0:1789498659.014084:0:14325:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498659.016044:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.016068:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.016077:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.016083:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498659.016140:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.016150:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.016172:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:2.0:1789498659.016176:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498659.016183:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.016191:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91600/0x3a6cb1946bc19a93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498659.016542:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.016678:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864702208 00000100:00100000:3.0:1789498659.016691:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864702208 00000100:00100000:3.0:1789498659.016756:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:3.0:1789498659.016765:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:14643:x1876424864702208:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498659.016793:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498659.016818:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19a9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5be expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.016901:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19a9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5be expref: 42 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.016915:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19a9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5be expref: 42 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.016933:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:3.0:1789498659.016935:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498659.016938:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91800, rc 0) 00000100:00100000:3.0:1789498659.017002:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14643:x1876424864702208:12345-192.168.201.20@tcp:101:bash.0 Request processed in 239us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498659.017008:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:0.0:1789498659.022426:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.024872:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864702336 00000100:00100000:2.0:1789498659.024894:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864702336 00000100:00100000:2.0:1789498659.025071:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:2.0:1789498659.025083:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14643:x1876424864702336:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498659.025149:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498659.025181:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19aa1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5c5 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.025316:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.025336:0:14323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 43 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.025347:0:14323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.025417:0:14323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 43 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.025430:0:14323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 43 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.025445:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14323:1876424885649664:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498659.025613:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84f12000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498659.028456:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.028633:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14323:1876424885649664:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498659.028678:0:14323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.028776:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864702464 00000100:00100000:3.0:1789498659.028786:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864702464 00010000:00010000:3.0:1789498659.028842:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 44 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.028917:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:3.0:1789498659.028930:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+44:2356:x1876424864702464:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498659.028953:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498659.028963:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 44 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.028978:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 44 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.029010:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd800/0x3a6cb1946bc19a85 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5b7 expref: 44 pid: 14324 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.029029:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:3.0:1789498659.029035:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.029047:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.029058:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.029157:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498659.029222:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+43:2356:x1876424864702464:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 295us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498659.029243:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00010000:00010000:2.0:1789498659.029437:0:14323:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.029446:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498659.029533:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789498659.029540:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498659.029569:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.029616:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19aa1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5c5 expref: 43 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.029635:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5c5 expref: 42 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.029661:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:2.0:1789498659.029664:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498659.029667:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcc800, rc 0) 00000100:00100000:2.0:1789498659.029699:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14643:x1876424864702336:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4619us (7292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.029706:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1789498659.033013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.033079:0:16441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864702720 00000100:00100000:3.0:1789498659.033147:0:16441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864702720 00000100:00100000:3.0:1789498659.033246:0:16441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1789498659.033260:0:16441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14643:x1876424864702720:12345-192.168.201.20@tcp:103:bash.0 00010000:00010000:3.0:1789498659.033282:0:16441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789498659.033318:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc800/0x3a6cb1946bc19aa8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5c5 expref: 42 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.033345:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19a9a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5be expref: 41 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.033359:0:16441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62f00) 00010000:00010000:3.0:1789498659.033372:0:16441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498659.033436:0:16441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+40:14643:x1876424864702720:12345-192.168.201.20@tcp:103:bash.0 Request processed in 180us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498659.033442:0:16441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:0.0:1789498659.035502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.035655:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864702848 00000100:00100000:3.0:1789498659.035670:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864702848 00000100:00100000:2.0:1789498659.035835:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:2.0:1789498659.035850:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+40:14643:x1876424864702848:12345-192.168.201.20@tcp:58:bash.0 00010000:00010000:2.0:1789498659.036018:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.036034:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.036044:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498659.036731:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:2.0:1789498659.036858:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+40:14643:x1876424864702848:12345-192.168.201.20@tcp:58:bash.0 Request processed in 1010us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.036869:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:1.0:1789498659.039376:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.039474:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864702976 00000100:00100000:3.0:1789498659.039488:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864702976 00000100:00100000:3.0:1789498659.041050:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1789498659.041079:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+40:14643:x1876424864702976:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1789498659.041137:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498659.041167:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5cc expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.041272:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.041307:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5cc expref: 41 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.041333:0:14325:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.041351:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5cc expref: 41 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.041370:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:3.0:1789498659.041372:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498659.041376:0:14325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5cc expref: 41 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.041381:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90e00, rc 0) 00000100:00100000:3.0:1789498659.041456:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:14643:x1876424864702976:12345-192.168.201.20@tcp:101:bash.0 Request processed in 392us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498659.041461:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000040:00080000:2.0:1789498659.115502:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498659.115530:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498659.115620:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789498659.115628:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498659.115838:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14357:1876424885649792:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789498659.115993:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498659.127172:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.127465:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14357:1876424885649792:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789498659.130137:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864703104 00000100:00100000:3.0:1789498659.130161:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864703104 00000100:00100000:3.0:1789498659.130381:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:3.0:1789498659.130396:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:14644:x1876424864703104:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498659.130449:0:16313:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498659.130637:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:14644:x1876424864703104:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 243us (3479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498659.130646:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:0.0:1789498659.136420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.136482:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864703232 00000100:00100000:2.0:1789498659.136497:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864703232 00000100:00100000:2.0:1789498659.136644:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:2.0:1789498659.136658:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:14644:x1876424864703232:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789498659.137063:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137487:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137507:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137530:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137539:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137554:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137587:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137596:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137603:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498659.137691:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789498659.137697:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498659.137729:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137743:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137750:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137758:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137764:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498659.137770:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137779:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137805:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea82c62800) 00010000:00010000:2.0:1789498659.137809:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498659.137815:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137822:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc600/0x3a6cb1946bc19abd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137837:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137854:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137861:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137866:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadccc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498659.137880:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137888:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137896:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff98ea82c62c00) 00010000:00010000:2.0:1789498659.137899:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498659.137902:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137909:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadccc00/0x3a6cb1946bc19ac4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137927:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.137933:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.138015:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.138023:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcca00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498659.138032:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.138039:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.138046:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:2.0:1789498659.138049:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498659.138052:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.138057:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19acb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.138235:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:14644:x1876424864703232:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 Request processed in 1566us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.138246:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:0.0:1789498659.142741:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.142890:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864703488 00000100:00100000:2.0:1789498659.142907:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864703488 00000100:00100000:2.0:1789498659.143003:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1789498659.143015:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+41:14644:x1876424864703488:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498659.143045:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498659.143078:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19ad2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5d3 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143312:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143333:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143368:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498659.143386:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789498659.143549:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143559:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143567:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143574:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498659.143579:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143588:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143603:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:2.0:1789498659.143606:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498659.143613:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143620:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd200/0x3a6cb1946bc19ad9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143683:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19ad2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5d3 expref: 43 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143706:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea82c62800) 00010000:00010000:2.0:1789498659.143709:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498659.143713:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19ad2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5d3 expref: 43 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.143724:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcd400, rc 0) 00000100:00100000:2.0:1789498659.143824:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14644:x1876424864703488:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 811us (1099us total) trans 8589934656 rc 301/301 00000100:00100000:2.0:1789498659.143832:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:0.0:1789498659.150438:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.150613:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864703616 00000100:00100000:3.0:1789498659.150627:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864703616 00000100:00100000:3.0:1789498659.150709:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:3.0:1789498659.150731:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14644:x1876424864703616:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498659.150785:0:14325:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498659.151435:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14644:x1876424864703616:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 702us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498659.151448:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:0.0:1789498659.158925:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.159291:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864703872 00000100:00100000:2.0:1789498659.159317:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864703872 00000100:00100000:2.0:1789498659.159398:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:2.0:1789498659.159411:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+42:14644:x1876424864703872:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498659.159439:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498659.159466:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19ae7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5da expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789498659.161694:0:14324:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1789498659.161710:0:14324:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789498659.162072:0:14324:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789498659.163064:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19aee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.163182:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19aee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.163200:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19aee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.163366:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcd400/0x3a6cb1946bc19ae7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5da expref: 45 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.163393:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19aee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5da expref: 44 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.163404:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea84ebf300) 00010000:00010000:0.0:1789498659.163408:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789498659.163413:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4200, rc 0) 00000100:00100000:0.0:1789498659.163526:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+44:14644:x1876424864703872:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 4116us (4617us total) trans 8589934657 rc 0/0 00000100:00100000:0.0:1789498659.163618:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:0.0:1789498659.169924:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.171634:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864704128 00000100:00100000:1.0:1789498659.171653:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864704128 00000100:00100000:1.0:1789498659.172057:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:1.0:1789498659.172072:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+44:14644:x1876424864704128:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789498659.172189:0:14323:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498659.172236:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19aee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5da expref: 44 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172269:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea84ebf300) 00010000:00010000:1.0:1789498659.172285:0:14323:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498659.172322:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172341:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172376:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172394:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172400:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172407:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172501:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172509:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172517:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172524:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498659.172529:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172538:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172803:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498659.172807:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498659.172813:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172826:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00600/0x3a6cb1946bc19afc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172838:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172844:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172850:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172855:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498659.172859:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172866:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172884:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x13a9e74c (ffff98ea83c9ce00) 00010000:00010000:1.0:1789498659.172887:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498659.172890:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.172896:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b03 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x13a9e74c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498659.173084:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+43:14644:x1876424864704128:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 1014us (3173us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789498659.173430:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:3.0:1789498659.179816:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.180583:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864704256 00000100:00100000:1.0:1789498659.180598:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864704256 00000100:00100000:1.0:1789498659.180689:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:1.0:1789498659.180703:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+43:14644:x1876424864704256:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498659.180742:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498659.180776:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19b0a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5e1 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.180838:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc19b11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.180857:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc19b11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.180882:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc19b11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.181048:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc19b0a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e1 expref: 45 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.181073:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc19b11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e1 expref: 44 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.181083:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498659.181116:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789498659.181121:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01c00, rc 0) 00000100:00100000:1.0:1789498659.181206:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+44:14644:x1876424864704256:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 506us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498659.181214:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:0.0:1789498659.187765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.188590:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864704512 00000100:00100000:3.0:1789498659.188607:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864704512 00000100:00100000:3.0:1789498659.188697:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:3.0:1789498659.188710:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+44:14644:x1876424864704512:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498659.189209:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.189244:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.189260:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498659.195067:0:14325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789498659.195653:0:14325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 558959560503ns, next at 559959552351ns, rc = 0 00000004:00010000:2.0:1789498659.196218:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035b2b3f6 reply state 00000000b62aa8a9 transno 8589934658 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.196247:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498659.197066:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+46:14644:x1876424864704512:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 8349us (9308us total) trans 8589934658 rc 0/0 00000100:00100000:2.0:1789498659.197079:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00010000:00010000:0.0:1789498659.204378:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.204404:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.204414:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.204422:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498659.204429:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.204439:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.204463:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:0.0:1789498659.204467:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789498659.204474:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.204481:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91800/0x3a6cb1946bc19b18 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.204648:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.206201:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864704640 00000100:00100000:3.0:1789498659.206230:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864704640 00000100:00100000:2.0:1789498659.207008:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:2.0:1789498659.207023:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+45:14644:x1876424864704640:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498659.207057:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498659.207086:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5e8 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.207200:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 46 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.207219:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 46 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.207259:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:2.0:1789498659.207264:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498659.207269:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcca00, rc 0) 00000100:00100000:2.0:1789498659.207377:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+46:14644:x1876424864704640:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 357us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.207385:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:3.0:1789498659.210844:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.211694:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864704768 00000100:00100000:1.0:1789498659.211715:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864704768 00000100:00100000:1.0:1789498659.211824:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:1.0:1789498659.211836:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2356:x1876424864704768:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789498659.212417:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864704768:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 582us (1586us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789498659.212426:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00080000:3.0:1789498659.213701:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498659.214479:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.214521:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864705024 00000100:00100000:1.0:1789498659.214534:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864705024 00000100:00100000:1.0:1789498659.214611:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:1.0:1789498659.214624:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2357:x1876424864705024:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498659.215254:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2357:x1876424864705024:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 629us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498659.215265:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:0.0:1789498659.217177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.217265:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864704896 00000100:00100000:0.0:1789498659.217283:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864704896 00000100:00080000:1.0:1789498659.217397:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498659.217783:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.218042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.218071:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498659.218150:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.218394:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864705280 00000100:00100000:1.0:1789498659.218404:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864705280 00000100:00100000:1.0:1789498659.218490:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864705408 00000100:00100000:1.0:1789498659.218493:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864705408 00000100:00100000:1.0:1789498659.218517:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:1.0:1789498659.218530:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2357:x1876424864705280:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498659.218626:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2357:x1876424864705280:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 99us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498659.218635:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:1.0:1789498659.218653:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:1.0:1789498659.218669:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2358:x1876424864705408:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498659.219118:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:0.0:1789498659.219127:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864704896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498659.219161:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864704896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.219167:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00080000:3.0:1789498659.219433:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498659.219439:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498659.219602:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864705152 00000100:00100000:2.0:1789498659.219609:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864705152 00000100:00100000:2.0:1789498659.219663:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:2.0:1789498659.219671:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864705152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498659.219814:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864705152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 144us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.219822:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00080000:3.0:1789498659.220074:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498659.220470:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2358:x1876424864705408:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 43us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498659.220484:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:1.0:1789498659.220535:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864705664 00000100:00100000:1.0:1789498659.220542:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864705664 00000100:00100000:1.0:1789498659.220586:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1789498659.220594:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8700ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+46:14644:x1876424864705664:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789498659.222020:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8700ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+47:14644:x1876424864705664:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 1417us (3859us total) trans 8589934659 rc 0/0 00000100:00100000:1.0:1789498659.222034:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1789498659.225506:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.226188:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864705920 00000100:00100000:0.0:1789498659.226201:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864705920 00000100:00100000:0.0:1789498659.226370:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:0.0:1789498659.226385:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+47:14644:x1876424864705920:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789498659.226539:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+47:14644:x1876424864705920:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 158us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.226547:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:2.0:1789498659.229180:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.229252:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864706048 00000100:00100000:0.0:1789498659.229400:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864706048 00000100:00100000:0.0:1789498659.229537:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:0.0:1789498659.229551:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+47:14644:x1876424864706048:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789498659.229578:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498659.229607:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19b26 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5ef expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.229722:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.229742:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.229757:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498659.229839:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498659.229863:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.229905:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19b26 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5ef expref: 49 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.229929:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5ef expref: 48 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.229948:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:0.0:1789498659.229952:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789498659.229957:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4c00, rc 0) 00000100:00100000:0.0:1789498659.230040:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+48:14644:x1876424864706048:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 493us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.230050:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:3.0:1789498659.235241:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.235568:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864706176 00000100:00100000:1.0:1789498659.235581:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864706176 00000100:00100000:1.0:1789498659.235655:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1789498659.235667:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864706176:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498659.235702:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498659.235741:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5f6 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498659.235779:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa99522, blocks: 0x1 00010000:00010000:1.0:1789498659.235808:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=558s v=(0 0) 00010000:00010000:1.0:1789498659.235813:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498659.235825:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 7 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.235881:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 7 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.235893:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00000, rc 0) 00000100:00100000:1.0:1789498659.236039:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2355:x1876424864706176:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 373us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498659.236047:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1789498659.239958:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.240059:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864706432 00000100:00100000:0.0:1789498659.240074:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864706432 00000100:00100000:0.0:1789498659.240182:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:0.0:1789498659.240191:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+48:14644:x1876424864706432:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789498659.240363:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+48:14644:x1876424864706432:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 172us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.240375:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:2.0:1789498659.243753:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:1.0:1789498659.243996:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498659.244023:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864706560 00000100:00100000:1.0:1789498659.244037:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864706560 00000100:00100000:1.0:1789498659.244150:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:1.0:1789498659.244163:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+48:14644:x1876424864706560:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789498659.279029:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934648 is committed 00000004:00080000:2.0:1789498659.279049:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789498659.279083:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98eab9d2f780 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:2.0:1789498659.279121:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea9829fa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98eab9d2f300 00000020:00080000:2.0:1789498659.279125:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea9829f900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98eaba262400 00000020:00080000:2.0:1789498659.279306:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:2.0:1789498659.279546:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1789498659.279573:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885649920:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789498659.279678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498659.280295:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885649920 00000100:00100000:2.0:1789498659.280308:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885649920 00000100:00100000:2.0:1789498659.280395:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789498659.280407:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885649920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789498659.280446:0:15007:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:34 count 1 00010000:00010000:2.0:1789498659.280483:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.280511:0:15007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.280521:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789498659.280526:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498659.280549:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.280588:0:15007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.280606:0:15007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 7 pid: 15007 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.280620:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15007:1876424885650048:192.168.201.20@tcp:104: 00000100:00080000:3.0:1789498659.280742:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498659.281894:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+39:14644:x1876424864706560:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 Request processed in 37726us (38147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498659.281907:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 100 00000001:00080000:0.0:1789498659.282360:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934659 is committed 00000004:00080000:0.0:1789498659.282391:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789498659.282853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885650176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789498659.282919:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498659.283035:0:15008:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789498659.283044:0:15008:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789498659.283419:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885650176 00000100:00100000:0.0:1789498659.283444:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885650176 00000100:00080000:0.0:1789498659.283514:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498659.283640:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498659.283653:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885650176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789498659.283909:0:16608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789498659.283914:0:16608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789498659.283917:0:16608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789498659.283919:0:16608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789498658 -> 1789498658 00002000:00010000:1.0:1789498659.283922:0:16608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789498659.283982:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885650176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 332us (1062us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789498659.283990:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789498659.284331:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9e40 going to sleep for 11 seconds 00000004:00080000:3.0:1789498659.284478:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eab9fbf800/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789498659.284487:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885650176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789498659.289010:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.289133:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864706688 00000100:00100000:2.0:1789498659.289147:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864706688 00010000:00010000:2.0:1789498659.289207:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 8 pid: 15007 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.289272:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:2.0:1789498659.289285:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2355:x1876424864706688:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498659.289308:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498659.289316:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 8 pid: 15007 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.289334:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 8 pid: 15007 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.289366:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498659.289385:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498659.289393:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.289406:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.289433:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498659.289501:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2355:x1876424864706688:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 219us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.289510:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00010000:00010000:3.0:1789498659.290108:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c87de42/0x3a6cb1946bc19997 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a586 expref: 7 pid: 15007 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.290131:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15007:1876424885650048:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498659.290160:0:15007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.290173:0:15007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.290180:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.290191:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.290218:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.290247:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498659.290845:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498659.290857:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.290868:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcda00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498659.290874:0:15943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.290885:0:15943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.290906:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.290914:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19b3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.290940:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498659.290943:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498659.290945:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498659.292027:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.292137:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864706816 00000100:00100000:0.0:1789498659.292149:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864706816 00000100:00100000:0.0:1789498659.292215:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1789498659.292239:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2356:x1876424864706816:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789498659.292407:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2356:x1876424864706816:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 Request processed in 170us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.292425:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:3.0:1789498659.293687:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885649920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13273us (14000us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789498659.293699:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498659.294983:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.295140:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864707072 00000100:00100000:0.0:1789498659.295154:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864707072 00000100:00100000:0.0:1789498659.295216:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:0.0:1789498659.295238:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14644:x1876424864707072:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789498659.295318:0:16313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498659.295360:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5ef expref: 14 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.295386:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:0.0:1789498659.295393:0:16313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498659.295437:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.295455:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.295467:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789498659.295703:0:16313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3884718 reply state 0000000047e481a4 transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498659.295713:0:16313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789498659.295862:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14644:x1876424864707072:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 626us (892us total) trans 8589934660 rc 0/0 00000100:00100000:0.0:1789498659.295871:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00010000:00010000:1.0:1789498659.298957:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.298981:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.298990:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.298997:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498659.299004:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.299014:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.299038:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498659.299041:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498659.299047:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.299054:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4600/0x3a6cb1946bc19b42 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.300548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000004:00080000:2.0:1789498659.301049:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eaba8f6680/2, rc 0, transno 8589934600 00000100:00100000:2.0:1789498659.301061:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885649920:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789498659.301487:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864707200 00000100:00100000:1.0:1789498659.301497:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864707200 00000100:00100000:1.0:1789498659.301607:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:1.0:1789498659.301620:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+7:2357:x1876424864707200:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789498659.301971:0:16608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789498659.301976:0:16608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789498658 00002000:00010000:1.0:1789498659.301979:0:16608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789498658 00002000:00010000:1.0:1789498659.301982:0:16608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789498658 -> 1789498658 00002000:00010000:1.0:1789498659.301984:0:16608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789498659.302120:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2357:x1876424864707200:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 501us (1585us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789498659.302129:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:3.0:1789498659.305248:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.305326:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864707328 00000100:00100000:2.0:1789498659.305341:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864707328 00000100:00100000:2.0:1789498659.305425:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1789498659.305438:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2356:x1876424864707328:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789498659.305505:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305529:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789498659.305534:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498659.305543:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305560:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305625:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305636:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305645:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305653:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498659.305659:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305671:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305691:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.305700:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19b49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.306196:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2356:x1876424864707328:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 Request processed in 759us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.306217:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1789498659.308796:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.309279:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864707584 00000100:00100000:2.0:1789498659.309294:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864707584 00000100:00100000:2.0:1789498659.309410:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:2.0:1789498659.309422:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14644:x1876424864707584:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789498659.309547:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.309570:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.309585:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.310075:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.310122:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 15 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.310133:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.310183:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 15 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.310203:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 15 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.310247:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885650304:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498659.310384:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498659.313360:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885650304:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498659.313403:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.314462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.314561:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864707712 00000100:00100000:0.0:1789498659.314593:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864707712 00010000:00010000:0.0:1789498659.314646:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 16 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498659.314695:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1789498659.314706:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+16:2355:x1876424864707712:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498659.314741:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498659.314751:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 16 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.314767:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 16 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.314805:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcca00/0x3a6cb1946bc19b1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e8 expref: 16 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.314828:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:0.0:1789498659.314833:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.314844:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.314855:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.314893:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498659.314971:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:2355:x1876424864707712:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 266us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.314990:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00010000:00010000:2.0:1789498659.315684:0:14325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.315699:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498659.316000:0:14325:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934661 00000001:00080000:2.0:1789498659.316243:0:14325:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934662 00000001:00080000:2.0:1789498659.316300:0:14325:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000100:00100000:2.0:1789498659.316412:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14325:1876424885650432:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789498659.316492:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498659.316531:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498659.316706:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885650432 00000100:00100000:0.0:1789498659.316716:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885650432 00000100:00100000:0.0:1789498659.316771:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498659.316782:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14325:x1876424885650432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789498659.316901:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14325:x1876424885650432:12345-0@lo:1000:mdt00_002.0 Request processed in 120us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.316909:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498659.317140:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14325:1876424885650432:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789498659.317771:0:14325:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000100:00100000:1.0:1789498659.317973:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14325:1876424885650560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789498659.318028:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498659.318059:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498659.318446:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885650560 00000100:00100000:2.0:1789498659.318453:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885650560 00000100:00100000:2.0:1789498659.318495:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498659.318504:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14325:x1876424885650560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789498659.318732:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14325:x1876424885650560:12345-0@lo:1000:mdt00_002.0 Request processed in 221us (696us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789498659.318741:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498659.319052:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14325:1876424885650560:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789498659.319132:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319145:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319154:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319161:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcde00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498659.319167:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319194:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319216:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498659.319229:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498659.319236:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319243:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcde00/0x3a6cb1946bc19b57 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319274:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319281:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319288:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319293:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498659.319296:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319301:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319309:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:1.0:1789498659.319311:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498659.319320:0:14325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5cc expref: 18 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319345:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5cc expref: 18 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319356:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5cc expref: 18 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.319394:0:14325:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5cc expref: 18 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498659.319409:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885650688:192.168.201.20@tcp:105: 00000100:00100000:1.0:1789498659.319491:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498659.323884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.324967:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885650688:192.168.201.20@tcp:105: 00010000:00010000:1.0:1789498659.325008:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.325021:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc000/0x3a6cb1946bc19aaf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.325240:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864707840 00000100:00100000:2.0:1789498659.325278:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864707840 00000100:00100000:2.0:1789498659.325352:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:2.0:1789498659.325364:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14643:x1876424864707840:12345-192.168.201.20@tcp:49:bash.0 00000100:00100000:2.0:1789498659.325547:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+19:14643:x1876424864707840:12345-192.168.201.20@tcp:49:bash.0 Request processed in 185us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.325556:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00010000:00010000:0.0:1789498659.326954:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.326985:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327000:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327017:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327024:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327031:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327039:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498659.327044:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327077:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327231:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:0.0:1789498659.327235:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498659.327241:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327248:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b5e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327263:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327270:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327275:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327281:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcce00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498659.327284:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327291:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327299:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:0.0:1789498659.327301:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789498659.327304:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.327321:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcce00/0x3a6cb1946bc19b50 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.328311:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.328625:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864707968 00000100:00100000:0.0:1789498659.328637:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864707968 00000100:00100000:0.0:1789498659.328917:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:0.0:1789498659.328931:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:14643:x1876424864707968:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1789498659.328957:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498659.328985:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028baf00c/0x3a6cb1946bc19b65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a5fd expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.329029:0:15008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 9 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.329040:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498659.329045:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498659.329051:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028baf00c/0x3a6cb1946bc19b65 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5fd expref: 9 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.329236:0:15008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 9 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.329254:0:15008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 9 pid: 15008 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498659.329271:0:15008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15008:1876424885650816:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498659.329436:0:15008:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab9d2fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498659.329470:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+18:14644:x1876424864707584:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 20049us (20767us total) trans 8589934665 rc 0/0 00000100:00100000:0.0:1789498659.329482:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 102 00000020:00080000:0.0:1789498659.329488:0:14325:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789498659.329907:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498659.329913:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498659.329955:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789498659.329961:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498659.333279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.333350:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.333457:0:15008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15008:1876424885650816:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498659.333502:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028baf00c/0x3a6cb1946bc19b65 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5fd expref: 9 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.333529:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5600, rc 0) 00000100:00100000:0.0:1789498659.333616:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:14643:x1876424864707968:12345-192.168.201.20@tcp:101:bash.0 Request processed in 4687us (5311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.333627:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:2.0:1789498659.333835:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864708352 00000100:00100000:2.0:1789498659.333845:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864708352 00010000:00010000:2.0:1789498659.333885:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 9 pid: 15008 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.333925:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:2.0:1789498659.333936:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+9:2355:x1876424864708352:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498659.333953:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498659.333989:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 9 pid: 15008 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.334005:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 9 pid: 15008 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.334033:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a825d967/0x3a6cb1946bc19b34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5f6 expref: 9 pid: 15008 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.334079:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498659.334085:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498659.334124:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028baf00c/0x3a6cb1946bc19b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5fd expref: 8 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.334138:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028baf00c/0x3a6cb1946bc19b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5fd expref: 8 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.334182:0:14310:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028baf00c/0x3a6cb1946bc19b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5fd expref: 8 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498659.334200:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14310:1876424885650944:192.168.201.20@tcp:105: 00000100:00100000:2.0:1789498659.334284:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82ce0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789498659.334304:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864708224 00000100:00100000:2.0:1789498659.334308:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864708224 00000100:00100000:2.0:1789498659.334345:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:2.0:1789498659.334353:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+18:14644:x1876424864708224:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789498659.335282:0:14327:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789498659.335417:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00010000:00010000:2.0:1789498659.335477:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335502:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335515:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335534:0:14327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335542:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335549:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335578:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789498659.335685:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+20:14644:x1876424864708224:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 1327us (2416us total) trans 8589934667 rc 0/0 00000100:00100000:2.0:1789498659.335695:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000020:00080000:2.0:1789498659.335701:0:14327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789498659.335749:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498659.335757:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335766:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498659.335770:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335779:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335794:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:2.0:1789498659.335798:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789498659.335804:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335821:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadcc400/0x3a6cb1946bc19b6c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.335840:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498659.335843:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498659.335845:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498659.343940:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14310:1876424885650944:192.168.201.20@tcp:105: 00010000:00010000:2.0:1789498659.343981:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498659.344155:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2355:x1876424864708352:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 10218us (10801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498659.344169:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1789498659.344379:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498659.344536:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864708608 00000100:00100000:2.0:1789498659.344546:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864708608 00000100:00100000:2.0:1789498659.344608:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:2.0:1789498659.344619:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+20:14643:x1876424864708608:12345-192.168.201.20@tcp:35:bash.0 00000001:00080000:2.0:1789498659.345135:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00000100:00100000:2.0:1789498659.346387:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+22:14643:x1876424864708608:12345-192.168.201.20@tcp:35:bash.0 Request processed in 1757us (1997us total) trans 8589934669 rc 0/0 00000100:00100000:2.0:1789498659.346402:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000020:00080000:2.0:1789498659.346409:0:14327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789498659.405061:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.405437:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864708736 00000100:00100000:0.0:1789498659.405451:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864708736 00000100:00100000:0.0:1789498659.405518:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:0.0:1789498659.405533:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+22:14650:x1876424864708736:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498659.405574:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498659.405603:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a604 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.405703:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.405734:0:16313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.405772:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498659.405826:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789498659.405828:0:16313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498659.405845:0:16313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.405871:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a604 expref: 24 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.405888:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a604 expref: 23 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.405895:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:0.0:1789498659.405898:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498659.405901:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4c00, rc 0) 00000100:00100000:0.0:1789498659.405973:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:14650:x1876424864708736:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 446us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.405978:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:0.0:1789498659.409128:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.409290:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864708864 00000100:00100000:1.0:1789498659.409304:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864708864 00000100:00100000:1.0:1789498659.409382:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:1.0:1789498659.409394:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+23:14650:x1876424864708864:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498659.409422:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498659.409453:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19b81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a60b expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.409575:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.409595:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.409609:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.409627:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.409634:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498659.409641:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411334:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411361:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411376:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498659.411475:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00000004:00200000:0.0:1789498659.411480:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789498659.411508:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411524:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411535:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411541:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411549:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411555:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498659.411561:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411570:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411586:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:0.0:1789498659.411589:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498659.411596:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411603:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00000/0x3a6cb1946bc19b88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411630:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411637:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411643:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411649:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498659.411652:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411659:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411668:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea83c9c300) 00010000:00010000:0.0:1789498659.411670:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498659.411673:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411679:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc19b8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411731:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00200/0x3a6cb1946bc19b81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 25 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411749:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 24 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.411768:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:0.0:1789498659.411770:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789498659.411773:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4a00, rc 0) 00000100:00100000:0.0:1789498659.411883:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+24:14650:x1876424864708864:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 2490us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.411894:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:3.0:1789498659.416478:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.416600:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864709120 00000100:00100000:0.0:1789498659.416614:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864709120 00000100:00100000:0.0:1789498659.416774:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:0.0:1789498659.416796:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+24:14650:x1876424864709120:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498659.416825:0:16313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498659.416853:0:16313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19b9d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a612 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.417002:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.417021:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 25 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.417030:0:16313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.417073:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 25 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.417148:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 25 pid: 14323 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498659.417186:0:16313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16313:1876424885651072:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498659.417347:0:16313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab9d2fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498659.421010:0:16313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16313:1876424885651072:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498659.421059:0:16313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.422859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.423652:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864709248 00000100:00100000:0.0:1789498659.423665:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864709248 00010000:00010000:0.0:1789498659.423719:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 26 pid: 14323 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498659.423778:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:0.0:1789498659.423789:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+26:2356:x1876424864709248:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498659.423812:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498659.423821:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 26 pid: 14323 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.423837:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 26 pid: 14323 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.423864:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19b96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a60b expref: 26 pid: 14323 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.423885:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:0.0:1789498659.423891:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.423921:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.423930:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.423972:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498659.424038:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+25:2356:x1876424864709248:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 251us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.424047:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00010000:00010000:2.0:1789498659.424130:0:16313:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.424139:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498659.424165:0:16313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789498659.424422:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc19b9d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 26 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.424442:0:16313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 25 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498659.424450:0:16313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:2.0:1789498659.424453:0:16313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498659.424456:0:16313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4000, rc 0) 00000100:00100000:2.0:1789498659.424499:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+25:14650:x1876424864709120:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 7715us (8040us total) trans 8589934670 rc 0/0 00000100:00100000:2.0:1789498659.424518:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:3.0:1789498659.456559:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.457251:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864709376 00000100:00100000:0.0:1789498659.457412:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864709376 00000100:00100000:0.0:1789498659.457504:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:0.0:1789498659.457517:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+25:14652:x1876424864709376:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498659.457566:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498659.457600:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19bb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a619 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.457986:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458006:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458021:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458039:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458059:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458066:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458701:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458897:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 26 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458908:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458958:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 26 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.458980:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 26 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498659.458998:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885651200:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498659.459596:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab9d2fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498659.463515:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498659.463631:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864709632 00000100:00100000:1.0:1789498659.463648:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864709632 00000100:00100000:1.0:1789498659.463810:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:1.0:1789498659.463824:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:13743:x1876424864709632:12345-192.168.201.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789498659.464286:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:13743:x1876424864709632:12345-192.168.201.20@tcp:35:ldlm_bl.0 Request processed in 464us (786us total) trans 8589934671 rc 0/0 00000100:00100000:1.0:1789498659.464295:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:2.0:1789498659.465050:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1876424885651200:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498659.465118:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498659.467436:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498659.467560:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864709760 00000100:00100000:0.0:1789498659.467575:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864709760 00010000:00010000:0.0:1789498659.467634:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 28 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498659.467734:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:0.0:1789498659.467747:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea87230850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+28:2356:x1876424864709760:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498659.467770:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498659.467779:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 28 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.467804:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 28 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.467838:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4000/0x3a6cb1946bc19ba4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a612 expref: 28 pid: 16313 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.467861:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:0.0:1789498659.467867:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.467879:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.467890:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498659.467936:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498659.468011:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea87230850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+27:2356:x1876424864709760:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 266us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498659.468020:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00010000:00010000:3.0:1789498659.469029:0:14325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469042:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498659.469160:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00000004:00200000:3.0:1789498659.469183:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498659.469228:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469248:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469260:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469268:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469275:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469282:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498659.469287:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469296:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469311:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:3.0:1789498659.469316:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498659.469321:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469328:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc19bb9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469344:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469362:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469368:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469373:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498659.469377:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469384:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469393:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98ea84ebf800) 00010000:00010000:3.0:1789498659.469396:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498659.469398:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469404:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4200/0x3a6cb1946bc19bc0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469455:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc19bb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a619 expref: 27 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469471:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a619 expref: 26 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498659.469478:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:3.0:1789498659.469481:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498659.469492:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4800, rc 0) 00000100:00100000:3.0:1789498659.469573:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+26:14652:x1876424864709376:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 12057us (13029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498659.469584:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 106 00010000:00010000:3.0:1789498660.267288:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498660.557954:0:16646:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498660.557969:0:16646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498660.558034:0:16646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498660.558047:0:16646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498660.844579:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885651456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498660.844658:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885651584:0@lo:400:kworker.0 00000100:00100000:2.0:1789498660.844685:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498660.844755:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885651328:0@lo:400:kworker.0 00000100:00100000:0.0:1789498660.844761:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498660.844791:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885651968:0@lo:400:kworker.0 00000100:00100000:0.0:1789498660.844811:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885652096:0@lo:400:kworker.0 00000100:00100000:3.0:1789498660.844824:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498660.844856:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498660.844875:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885651840:0@lo:400:kworker.0 00000100:00100000:3.0:1789498660.844919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498660.844934:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885651968 00000100:00100000:2.0:1789498660.844945:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885651968 00000100:00100000:3.0:1789498660.844980:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885651328 00000100:00100000:3.0:1789498660.844989:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885651328 00000100:00100000:2.0:1789498660.845032:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885651840 00000100:00100000:2.0:1789498660.845040:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885651840 00000100:00100000:3.0:1789498660.845051:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789498660.845066:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885651328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498660.845117:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498660.845136:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885651968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498660.845165:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885651328:12345-0@lo:400:kworker.0 Request processed in 100us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498660.845173:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789498660.845240:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498660.845257:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885651840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498660.845263:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885651968:12345-0@lo:400:kworker.0 Request processed in 114us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498660.845296:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789498660.845305:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885651840:12345-0@lo:400:kworker.0 Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498660.845315:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498660.845380:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885651328:0@lo:400:kworker.0 00000100:00100000:3.0:1789498660.845393:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885651840:0@lo:400:kworker.0 00000100:00100000:2.0:1789498660.845468:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885651968:0@lo:400:kworker.0 00000100:00100000:1.0:1789498660.851421:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885651584 00000100:00100000:1.0:1789498660.851450:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885651584 00000100:00100000:1.0:1789498660.851560:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498660.851578:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885651584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498660.851801:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885651584:12345-0@lo:400:kworker.0 Request processed in 228us (7039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498660.851811:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498660.851853:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885651456 00000100:00100000:1.0:1789498660.851859:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885651456 00000100:00100000:1.0:1789498660.851896:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498660.851904:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876424885651456:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498660.853330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789498660.853395:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498660.853491:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885651584:0@lo:400:kworker.0 00000100:00100000:0.0:1789498660.853524:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498660.853539:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885651712:0@lo:400:kworker.0 00000100:00100000:0.0:1789498660.853592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498660.853624:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885651712 00000100:00100000:2.0:1789498660.853641:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885651712 00000100:00100000:2.0:1789498660.853770:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498660.853782:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1876424885651712:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789498660.854083:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498660.854234:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1876424885651712:12345-0@lo:400:kworker.0 Request processed in 453us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498660.854244:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498660.854411:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885652096 00000100:00100000:2.0:1789498660.854417:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885652096 00000100:00100000:2.0:1789498660.854579:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789498660.854586:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885652096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498660.854622:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885652096:12345-0@lo:400:kworker.0 Request processed in 37us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498660.854628:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789498660.855810:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498660.855879:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885651712:0@lo:400:kworker.0 00000100:00100000:0.0:1789498660.855901:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885652096:0@lo:400:kworker.0 00000100:00100000:1.0:1789498660.862594:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876424885651456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10485us (17710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498660.862619:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498660.862735:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885651456:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789498660.950461:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1789498660.950481:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1789498660.950491:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:0.0:1789498661.291568:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498661.783370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498661.783440:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498661.783628:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864710016 00000100:00100000:3.0:1789498661.783645:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864710016 00000100:00100000:3.0:1789498661.783768:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1789498661.783783:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864710016:12345-192.168.201.20@tcp:16:kworker.0 00000100:00100000:3.0:1789498661.783988:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864710016:12345-192.168.201.20@tcp:16:kworker.0 Request processed in 209us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498661.783997:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1789498661.784214:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864709888 00000100:00100000:2.0:1789498661.784219:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864709888 00002000:00100000:2.0:1789498661.784259:0:15012:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->12) req@ffff98e987729180 x1876424864709888/t0(0) o4->68cd9685-a43a-48ba-9cd1-2238ca644a97@192.168.201.20@tcp:692/0 lens 504/0 e 0 to 0 dl 1789498672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789498661.784271:0:15012:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e987729180 with x1876424864709888 ext(0->12) 00002000:00010000:2.0:1789498661.784279:0:15012:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98e987729180 00000100:00100000:2.0:1789498661.784304:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:2.0:1789498661.784312:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864709888:12345-192.168.201.20@tcp:4:bash.0 00000100:00080000:1.0:1789498661.784624:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498661.789458:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2355:x1876424864709888:12345-192.168.201.20@tcp:4:bash.0 Request processed in 5128us (5998us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789498661.789486:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00002000:00100000:2.0:1789498661.789507:0:15012:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->12) req@ffff98e987729180 x1876424864709888/t8589934598(0) o4->68cd9685-a43a-48ba-9cd1-2238ca644a97@192.168.201.20@tcp:692/0 lens 504/448 e 0 to 0 dl 1789498672 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789498661.789521:0:15012:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e987729180 with x1876424864709888 ext(0->12) 00002000:00010000:2.0:1789498661.789529:0:15012:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98e987729180 00010000:00010000:2.0:1789498662.317885:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498662.379630:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498662.379658:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabafaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885652224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498662.379750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498662.379837:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885652224 00000100:00100000:3.0:1789498662.379847:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885652224 00000100:00100000:3.0:1789498662.379913:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498662.379925:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885652224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498662.379973:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498662.380025:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876424885652224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498662.380033:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789498662.380060:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498662.380174:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabafaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885652224:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789498662.844293:0:16698:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498662.844307:0:16698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498662.844369:0:16698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498662.844381:0:16698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498663.342987:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789498663.501001:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1789498663.502493:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:3.0:1789498664.340470:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498664.340520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498664.340552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498664.340576:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498664.340600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498664.340644:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864710400 00000100:00100000:3.0:1789498664.340668:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864710400 00000100:00100000:3.0:1789498664.340743:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864710528 00000100:00100000:3.0:1789498664.340747:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864710528 00000100:00100000:3.0:1789498664.340773:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1789498664.340784:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864710400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498664.340870:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864710400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498664.340878:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1789498664.340895:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:3.0:1789498664.340901:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2355:x1876424864710528:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498664.340928:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+8:2355:x1876424864710528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498664.340934:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:3.0:1789498664.340952:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864710656 00000100:00100000:3.0:1789498664.340956:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864710656 00000100:00100000:3.0:1789498664.340984:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864710272 00000100:00100000:3.0:1789498664.340987:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864710272 00000100:00100000:3.0:1789498664.341007:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:3.0:1789498664.341013:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864710656:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498664.341041:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864710656:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498664.341048:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:3.0:1789498664.341060:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:3.0:1789498664.341066:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+26:2355:x1876424864710272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498664.341542:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+26:2355:x1876424864710272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 472us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498664.341562:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00080000:3.0:1789498664.341600:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498664.341607:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498664.341609:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498664.343759:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864710144 00000100:00100000:0.0:1789498664.343778:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864710144 00000100:00100000:0.0:1789498664.343845:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:0.0:1789498664.343855:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864710144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498664.343931:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864710144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (3473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498664.343940:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:3.0:1789498664.356993:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498664.357042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498664.357156:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864710784 00000100:00100000:2.0:1789498664.357170:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864710784 00000100:00100000:2.0:1789498664.357233:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864710912 00000100:00100000:2.0:1789498664.357236:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864710912 00000100:00100000:2.0:1789498664.357257:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:2.0:1789498664.357266:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2354:x1876424864710784:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:2.0:1789498664.357300:0:16608:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc195b5 00000100:00080000:2.0:1789498664.357319:0:16608:0:(import.c:65:import_set_state_nolock()) ffff98ea891f6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789498664.357367:0:16608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789498664.357859:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+2:2354:x1876424864710784:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 592us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498664.357868:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:2.0:1789498664.357889:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1789498664.357897:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2354:x1876424864710912:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:2.0:1789498664.357911:0:16608:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc195bc 00000100:00080000:2.0:1789498664.357919:0:16608:0:(import.c:65:import_set_state_nolock()) ffff98ea8925c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789498664.357947:0:16608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1789498664.358076:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+2:2354:x1876424864710912:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 180us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498664.358084:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00010000:00010000:2.0:1789498664.358511:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498664.359729:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498664.359739:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789498664.362061:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498664.365547:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789498664.499548:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934660 is committed 00000001:00080000:0.0:1789498664.499578:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934671 is committed 00000020:00080000:0.0:1789498664.499603:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98ea85cdfb40 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:0.0:1789498664.499608:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea85041e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98ea85cdf000 00000020:00080000:0.0:1789498664.499611:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98ea85041500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98eaba1eec00 00000020:00080000:0.0:1789498664.499655:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:3.0:1789498664.499795:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 4294967527 00000020:00080000:3.0:1789498664.500007:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:00080000:2.0:1789498664.890929:0:16752:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498664.890941:0:16752:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498664.890994:0:16752:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789498664.891000:0:16752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498665.389069:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498665.963573:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885652736:0@lo:400:kworker.0 00000100:00100000:0.0:1789498665.963719:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498665.963816:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498665.963823:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885652608:0@lo:400:kworker.0 00000100:00100000:0.0:1789498665.963851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498665.963990:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885652480:0@lo:400:kworker.0 00000100:00100000:1.0:1789498665.964022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498665.964046:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885652992:0@lo:400:kworker.0 00000100:00100000:1.0:1789498665.964066:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498665.964082:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789498665.964149:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885652352:0@lo:400:kworker.0 00000100:00100000:1.0:1789498665.964211:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498665.964232:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885652864:0@lo:400:kworker.0 00000100:00100000:1.0:1789498665.964253:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498665.964390:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885652608 00000100:00100000:0.0:1789498665.964399:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885652608 00000100:00100000:2.0:1789498665.964537:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885652480 00000100:00100000:2.0:1789498665.964542:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885652480 00000100:00100000:0.0:1789498665.964610:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789498665.964631:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885652608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498665.964650:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e987729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885653120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498665.964689:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885652608:12345-0@lo:400:kworker.0 Request processed in 71us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498665.964697:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498665.964698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498665.964722:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885652352 00000100:00100000:0.0:1789498665.964725:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885652352 00000100:00100000:3.0:1789498665.964729:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885652736 00000100:00100000:3.0:1789498665.964732:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885652736 00000100:00100000:0.0:1789498665.964748:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789498665.964754:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885652352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498665.964756:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885652992 00000100:00100000:3.0:1789498665.964758:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885652992 00000100:00100000:0.0:1789498665.964795:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885652352:12345-0@lo:400:kworker.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498665.964801:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789498665.964847:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789498665.964852:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eab9fbf800, transno 8589934595 00000004:00080000:0.0:1789498665.964887:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1789498665.964913:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885652608:0@lo:400:kworker.0 00000100:00100000:0.0:1789498665.964977:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885652352:0@lo:400:kworker.0 00000100:00100000:0.0:1789498665.965424:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885652864 00000100:00100000:0.0:1789498665.965429:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885652864 00000100:00080000:1.0:1789498665.966040:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498665.966048:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498665.966051:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498665.967684:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789498665.967697:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885652480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498665.967813:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885652480:12345-0@lo:400:kworker.0 Request processed in 119us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498665.967821:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789498665.967887:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 2 00000004:00080000:2.0:1789498665.967893:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934600 00000004:00080000:2.0:1789498665.967912:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eaba8f6680, transno 8589934600 00000100:00100000:2.0:1789498665.967926:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885652480:0@lo:400:kworker.0 00000100:00100000:2.0:1789498665.968293:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498665.968303:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885652736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498665.968353:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885652736:12345-0@lo:400:kworker.0 Request processed in 51us (4633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498665.968359:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498665.968384:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885653120 00000100:00100000:2.0:1789498665.968392:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885653120 00000100:00100000:2.0:1789498665.968430:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498665.970672:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498665.971118:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885652992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498665.971235:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885652992:12345-0@lo:400:kworker.0 Request processed in 552us (7166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498665.971243:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498665.971306:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885652992:0@lo:400:kworker.0 00000100:00100000:2.0:1789498665.971429:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885653120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498665.971543:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498665.971657:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885653120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3212us (6957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498665.971667:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498665.971713:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e987729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885653120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498665.972265:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885652736:0@lo:400:kworker.0 00000100:00100000:0.0:1789498665.981756:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789498665.981783:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885652864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498665.981908:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885652864:12345-0@lo:400:kworker.0 Request processed in 132us (17653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498665.981916:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789498665.982248:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885652864:0@lo:400:kworker.0 00000001:00100000:1.0:1789498666.081079:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000020:00000080:1.0:1789498666.081121:0:7653:0:(genops.c:885:class_export_put()) final put ffff98ea8925f800/b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000001:00080000:1.0:1789498666.081156:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000020:00000080:0.0:1789498666.081240:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea8925f800/b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a for lustre-OST0001 00000020:00000080:0.0:1789498666.081304:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea8925c800 for lustre-OST0001 00010000:00010000:1.0:1789498666.411599:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498667.159961:0:16804:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498667.159971:0:16804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498667.160026:0:16804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1789498667.160033:0:16804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498667.441496:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498667.502427:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885653248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498667.502510:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498667.509160:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885653248 00000100:00100000:2.0:1789498667.509182:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885653248 00000100:00100000:2.0:1789498667.509258:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789498667.511921:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885653248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498667.511984:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498667.512158:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885653248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 261us (9646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498667.512168:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789498667.512209:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498667.512447:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885653248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789498668.462574:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498668.525497:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498668.525511:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498668.525550:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498668.525560:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00100000:3.0:1789498668.634131:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000020:00000080:3.0:1789498668.634164:0:6726:0:(genops.c:885:class_export_put()) final put ffff98ea891f0800/b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000020:00000080:1.0:1789498668.634306:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea891f0800/b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a for lustre-OST0000 00000020:00000080:1.0:1789498668.634374:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea891f6800 for lustre-OST0000 00000040:00080000:1.0:1789498669.390210:0:16857:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498669.390222:0:16857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498669.390272:0:16857:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498669.390278:0:16857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498669.458686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498669.458740:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498669.458780:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498669.458818:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864711424 00000100:00100000:2.0:1789498669.458833:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864711424 00000100:00100000:2.0:1789498669.458913:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1789498669.458925:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864711424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498669.459049:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864711424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 116us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498669.459058:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00080000:2.0:1789498669.459084:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498669.459168:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864711168 00000100:00100000:3.0:1789498669.459173:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864711168 00000100:00100000:3.0:1789498669.459229:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498669.459238:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864711168:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498669.459276:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864711168:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498669.459283:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498669.459303:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864711040 00000100:00100000:3.0:1789498669.459307:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864711040 00000100:00100000:3.0:1789498669.459335:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00100000:3.0:1789498669.459342:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864711040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498669.459380:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864711040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498669.459387:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00080000:2.0:1789498669.460069:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498669.471867:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498669.471929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498669.472007:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864711296 00000100:00100000:3.0:1789498669.472021:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864711296 00000100:00100000:3.0:1789498669.472136:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1789498669.472147:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864711296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498669.472230:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864711296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 84us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498669.472237:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00080000:1.0:1789498669.472529:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498669.472912:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864711552 00000100:00100000:0.0:1789498669.472920:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864711552 00000100:00100000:0.0:1789498669.473333:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:0.0:1789498669.473343:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864711552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:1.0:1789498669.474076:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498669.474906:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864711552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1545us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498669.474920:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00010000:00010000:3.0:1789498669.485005:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789498669.616739:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000020:00080000:3.0:1789498669.616791:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:3.0:1789498669.616805:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00010000:00010000:1.0:1789498670.507351:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498671.089856:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885653376:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.089998:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498671.090063:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885653888:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.090112:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498671.090140:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498671.090146:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885653504:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.090176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498671.090196:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885654016:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.090217:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498671.090260:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885653760:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.090285:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498671.090322:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498671.090327:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885653632:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.090353:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498671.090387:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885653376 00000100:00100000:3.0:1789498671.090395:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885653376 00000100:00100000:3.0:1789498671.090440:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789498671.090449:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885653376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498671.090783:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885654144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498671.094935:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885653888 00000100:00100000:1.0:1789498671.094955:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885653888 00000100:00100000:1.0:1789498671.095069:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885654016 00000100:00100000:1.0:1789498671.095073:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885654016 00000100:00100000:1.0:1789498671.095115:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885653760 00000100:00100000:1.0:1789498671.095137:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885653760 00000100:00100000:1.0:1789498671.095161:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789498671.095172:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885653888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498671.097756:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498671.097843:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885654144 00000100:00100000:2.0:1789498671.097853:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885654144 00000100:00100000:2.0:1789498671.097906:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498671.097915:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885654144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498671.097959:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498671.098026:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885654144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498671.098034:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498671.098110:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885654144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498671.099196:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789498671.099215:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885654016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498671.099299:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885654016:12345-0@lo:400:kworker.0 Request processed in 93us (9080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498671.099306:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789498671.099329:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789498671.099336:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885653760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498671.099370:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885653760:12345-0@lo:400:kworker.0 Request processed in 35us (9084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498671.099388:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789498671.099412:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885653504 00000100:00100000:2.0:1789498671.099419:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885653504 00000100:00100000:2.0:1789498671.099620:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885653632 00000100:00100000:2.0:1789498671.099626:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885653632 00000100:00100000:2.0:1789498671.099650:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498671.099656:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885653504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498671.099693:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885653504:12345-0@lo:400:kworker.0 Request processed in 38us (9515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498671.099700:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498671.099711:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789498671.099717:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885653632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498671.099746:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885653632:12345-0@lo:400:kworker.0 Request processed in 30us (9393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498671.099751:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789498671.099877:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885653376:12345-0@lo:400:kworker.0 Request processed in 9428us (9878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498671.099887:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789498671.099934:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885653504:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.099947:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885654016:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.099959:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885653376:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.100024:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885653632:0@lo:400:kworker.0 00000100:00100000:3.0:1789498671.100048:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885653760:0@lo:400:kworker.0 00000100:00080000:0.0:1789498671.100279:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498671.100292:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498671.100295:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498671.109675:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885653888:12345-0@lo:400:kworker.0 Request processed in 14496us (19554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498671.109692:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789498671.110116:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885653888:0@lo:400:kworker.0 00010000:00010000:0.0:1789498671.532965:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498671.602623:0:16911:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498671.602634:0:16911:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498671.602683:0:16911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498671.602690:0:16911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498672.556643:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498672.619839:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498672.619867:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885654272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498672.619947:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498672.620230:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885654272 00000100:00100000:3.0:1789498672.620241:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885654272 00000100:00100000:3.0:1789498672.620302:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789498672.620313:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885654272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498672.620355:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498672.620420:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885654272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498672.620428:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789498672.620521:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885654272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498673.580069:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498673.623280:0:16963:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498673.623291:0:16963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498673.623346:0:16963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498673.623352:0:16963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498674.574523:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498674.574574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498674.574610:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498674.574642:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498674.574664:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498674.574697:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864711936 00000100:00100000:3.0:1789498674.574712:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864711936 00000100:00100000:3.0:1789498674.574775:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864712064 00000100:00100000:3.0:1789498674.574778:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864712064 00000100:00100000:3.0:1789498674.574801:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1789498674.574811:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864711936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498674.574892:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2355:x1876424864711936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498674.574901:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1789498674.574918:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1789498674.574924:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864712064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498674.574988:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864712064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498674.574995:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:2.0:1789498674.575422:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864712192 00000100:00100000:2.0:1789498674.575429:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864712192 00000100:00100000:2.0:1789498674.575481:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864711808 00000100:00100000:2.0:1789498674.575484:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864711808 00000100:00100000:2.0:1789498674.575506:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:2.0:1789498674.575513:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864712192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498674.575559:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864712192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 46us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498674.575573:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:2.0:1789498674.575588:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:2.0:1789498674.575594:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864711808:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498674.575621:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864711808:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498674.575627:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:0.0:1789498674.575781:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864711680 00000100:00100000:0.0:1789498674.575787:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864711680 00000100:00100000:0.0:1789498674.575827:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:0.0:1789498674.575834:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864711680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498674.575867:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864711680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498674.575873:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00080000:0.0:1789498674.575901:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498674.575906:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498674.575908:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789498674.611030:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498675.627496:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498675.790060:0:17014:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498675.790072:0:17014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498675.794486:0:17014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498675.794500:0:17014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789498676.203421:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498676.203442:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885654400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498676.203506:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498676.203664:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885654400 00000100:00100000:2.0:1789498676.203671:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885654400 00000100:00100000:2.0:1789498676.203730:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498676.203737:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885654400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498676.203818:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498676.203881:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885654400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498676.203888:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789498676.203980:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498676.204511:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885654656:0@lo:400:kworker.0 00000100:00100000:1.0:1789498676.204562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498676.204601:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498676.204607:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885654784:0@lo:400:kworker.0 00000100:00100000:1.0:1789498676.204634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498676.204671:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885654784 00000100:00100000:1.0:1789498676.204676:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885654784 00000100:00100000:1.0:1789498676.204716:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789498676.204723:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885654784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498676.204769:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885654784:12345-0@lo:400:kworker.0 Request processed in 45us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498676.204796:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789498676.204847:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885654784:0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205027:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885654912:0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205059:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498676.205111:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498676.205118:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885654528:0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205150:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498676.205177:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885655040:0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205203:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498676.205232:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885654528 00000100:00100000:3.0:1789498676.205236:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885654528 00000100:00100000:3.0:1789498676.205268:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789498676.205274:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885654528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205312:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885654528:12345-0@lo:400:kworker.0 Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498676.205318:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789498676.205343:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885654912 00000100:00100000:3.0:1789498676.205347:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885654912 00000100:00100000:3.0:1789498676.205370:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885655040 00000100:00100000:3.0:1789498676.205373:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885655040 00000100:00100000:3.0:1789498676.205389:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789498676.205395:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885654912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205425:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885654912:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498676.205443:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789498676.205456:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789498676.205462:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885655040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205489:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885655040:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498676.205495:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789498676.205523:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885654528:0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205533:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885655040:0@lo:400:kworker.0 00000100:00100000:3.0:1789498676.205542:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885654912:0@lo:400:kworker.0 00000100:00100000:0.0:1789498676.205696:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885654400:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789498676.205819:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498676.206231:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885654656 00000100:00100000:2.0:1789498676.206238:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885654656 00000100:00100000:2.0:1789498676.206283:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789498676.206291:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885654656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498676.206351:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885654656:12345-0@lo:400:kworker.0 Request processed in 61us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498676.206357:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789498676.206415:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498676.206440:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885654656:0@lo:400:kworker.0 00010000:00010000:1.0:1789498676.651522:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498677.676279:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498677.741679:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498677.741707:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885655168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498677.741802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498677.741997:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885655168 00000100:00100000:3.0:1789498677.742010:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885655168 00000100:00100000:3.0:1789498677.742084:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789498677.742125:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885655168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498677.742175:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498677.742278:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885655168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498677.742285:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789498677.742402:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885655168:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498677.858411:0:17065:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498677.858421:0:17065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498677.858467:0:17065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1789498677.858474:0:17065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498678.699301:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498678.763592:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498678.763626:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498678.763674:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789498678.763681:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498679.701899:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498679.701952:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498679.702108:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864712448 00000100:00100000:1.0:1789498679.702123:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864712448 00000100:00100000:1.0:1789498679.702202:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:1.0:1789498679.702214:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864712448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498679.702297:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864712448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498679.702304:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:3.0:1789498679.703144:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864712320 00000100:00100000:3.0:1789498679.703155:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864712320 00000100:00100000:3.0:1789498679.703214:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:3.0:1789498679.703223:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864712320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498679.703264:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864712320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 42us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498679.703272:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00080000:2.0:1789498679.703364:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498679.724795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498679.724839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498679.724884:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498679.725031:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864712576 00000100:00100000:3.0:1789498679.725054:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864712576 00000100:00100000:3.0:1789498679.725140:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864712704 00000100:00100000:3.0:1789498679.725144:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864712704 00000100:00100000:3.0:1789498679.725175:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:3.0:1789498679.725186:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864712704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498679.725282:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864712704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 97us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498679.725290:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:3.0:1789498679.725530:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1789498679.725544:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+5:2354:x1876424864712576:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1789498679.725576:0:15006:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1957d 00000100:00080000:3.0:1789498679.725588:0:15006:0:(import.c:65:import_set_state_nolock()) ffff98e987724000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498679.725635:0:15006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:1.0:1789498679.727259:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498679.727267:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498679.727293:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864712832 00000100:00100000:1.0:1789498679.727303:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864712832 00000100:00100000:1.0:1789498679.727384:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:1.0:1789498679.727393:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864712832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498679.727485:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864712832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498679.727493:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00080000:1.0:1789498679.727513:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498679.741386:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+2:2354:x1876424864712576:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 15830us (16593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498679.741404:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00010000:00010000:3.0:1789498679.741622:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498679.741636:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498679.982252:0:17117:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498679.982263:0:17117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498679.982308:0:17117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498679.982319:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498680.748747:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498681.323511:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885655296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498681.323588:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498681.324541:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885655808:0@lo:400:kworker.0 00000100:00100000:1.0:1789498681.324585:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498681.324612:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498681.324619:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885655680:0@lo:400:kworker.0 00000100:00100000:1.0:1789498681.324641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498681.324670:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885655808 00000100:00100000:1.0:1789498681.324679:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885655808 00000100:00100000:1.0:1789498681.324732:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885655680 00000100:00100000:1.0:1789498681.324736:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885655680 00000100:00100000:1.0:1789498681.324757:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789498681.324767:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885655808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498681.324840:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885655808:12345-0@lo:400:kworker.0 Request processed in 60us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498681.324847:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789498681.324865:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789498681.324871:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885655680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498681.324899:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885655680:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498681.324905:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1789498681.324926:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498681.324965:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885655680:0@lo:400:kworker.0 00000100:00100000:1.0:1789498681.324976:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885655808:0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328015:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885655424:0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498681.328152:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885655936:0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328179:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498681.328211:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498681.328218:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885655552:0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328243:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498681.328356:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885655424 00000100:00100000:3.0:1789498681.328364:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885655424 00000100:00100000:3.0:1789498681.328407:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789498681.328414:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885655424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328464:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885655424:12345-0@lo:400:kworker.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498681.328472:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789498681.328504:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885655936 00000100:00100000:3.0:1789498681.328508:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885655936 00000100:00100000:3.0:1789498681.328543:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789498681.328550:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885655936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328580:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885655936:12345-0@lo:400:kworker.0 Request processed in 31us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498681.328586:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789498681.328604:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885655552 00000100:00100000:3.0:1789498681.328607:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885655552 00000100:00100000:3.0:1789498681.328633:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498681.328639:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885655552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328677:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885655552:12345-0@lo:400:kworker.0 Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498681.328683:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789498681.328701:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498681.328706:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498681.328740:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885655552:0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328749:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885655424:0@lo:400:kworker.0 00000100:00100000:3.0:1789498681.328758:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885655936:0@lo:400:kworker.0 00000100:00100000:0.0:1789498681.328948:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885655296 00000100:00100000:0.0:1789498681.328953:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885655296 00000100:00100000:0.0:1789498681.328990:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789498681.328997:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885655296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498681.329036:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498681.329078:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885655296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (5491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498681.329085:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789498681.329173:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885655296:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789498681.329189:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789498681.786179:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498682.148478:0:17168:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498682.148489:0:17168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498682.148795:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1789498682.148803:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498682.798676:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498682.859642:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498682.859690:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885656064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498682.859769:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498682.859960:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885656064 00000100:00100000:3.0:1789498682.859971:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885656064 00000100:00100000:3.0:1789498682.860032:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498682.860042:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885656064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498682.860115:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498682.860174:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885656064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498682.860181:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498682.860344:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885656064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498683.827229:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789498684.029966:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68cd9685-a43a-48ba-9cd1-2238ca644a97 00000020:00000080:3.0:1789498684.029978:0:6726:0:(genops.c:885:class_export_put()) final put ffff98e987724800/68cd9685-a43a-48ba-9cd1-2238ca644a97 00000020:00000080:2.0:1789498684.030042:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e987724800/68cd9685-a43a-48ba-9cd1-2238ca644a97 for lustre-OST0000 00000020:00000080:2.0:1789498684.030136:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e987724000 for lustre-OST0000 00000040:00080000:3.0:1789498684.289690:0:17221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498684.289702:0:17221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498684.289762:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1789498684.289770:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498684.822232:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498684.822352:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498684.823290:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864713088 00000100:00100000:3.0:1789498684.823303:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864713088 00000100:00080000:0.0:1789498684.823384:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498684.823406:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:3.0:1789498684.823418:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864713088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498684.823512:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864713088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 96us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498684.823520:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:3.0:1789498684.825946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498684.826045:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864712960 00000100:00100000:1.0:1789498684.826057:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864712960 00000100:00100000:1.0:1789498684.826253:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:1.0:1789498684.826272:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864712960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498684.826316:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498684.826347:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864712960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (4125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498684.826351:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864713216 00000100:00100000:3.0:1789498684.826355:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864713216 00000100:00100000:1.0:1789498684.826355:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:2.0:1789498684.826423:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864713344 00000100:00100000:2.0:1789498684.826428:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864713344 00000100:00100000:2.0:1789498684.826482:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:2.0:1789498684.826490:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864713344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498684.826524:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864713344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498684.826530:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00080000:2.0:1789498684.826548:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498684.826553:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498684.826882:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:3.0:1789498684.826889:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864713216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498684.826925:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864713216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498684.826932:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00010000:00010000:3.0:1789498684.843820:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498685.868403:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498686.335789:0:17272:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498686.335803:0:17272:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498686.336593:0:17272:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498686.336601:0:17272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498686.444013:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885656320:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.444112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498686.444162:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885656832:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.444186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498686.444221:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789498686.444296:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885656192:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.444395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498686.444418:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885656704:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.444457:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498686.444485:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885656448:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.444507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498686.444524:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498686.444529:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885656576:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.444549:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498686.444584:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885656832 00000100:00100000:2.0:1789498686.444593:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885656832 00000100:00100000:2.0:1789498686.444646:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885656704 00000100:00100000:2.0:1789498686.444649:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885656704 00000100:00100000:2.0:1789498686.444665:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885656576 00000100:00100000:2.0:1789498686.444668:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885656576 00000100:00100000:2.0:1789498686.444681:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498686.444689:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885656832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.444752:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885656832:12345-0@lo:400:kworker.0 Request processed in 63us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498686.444759:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498686.444776:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789498686.444782:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885656704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.444808:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885656704:12345-0@lo:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498686.444814:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789498686.444928:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885656320 00000100:00100000:3.0:1789498686.444933:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885656320 00000100:00100000:3.0:1789498686.444965:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885656448 00000100:00100000:3.0:1789498686.444968:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885656448 00000100:00100000:3.0:1789498686.444992:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498686.444999:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885656320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498686.445034:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885656320:12345-0@lo:400:kworker.0 Request processed in 36us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498686.445049:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498686.445063:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789498686.445070:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885656448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498686.445119:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885656448:12345-0@lo:400:kworker.0 Request processed in 50us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498686.445125:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789498686.445142:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789498686.445148:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885656576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498686.445173:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885656576:12345-0@lo:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498686.445178:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789498686.445195:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885656192 00000100:00100000:3.0:1789498686.445197:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885656192 00000100:00100000:3.0:1789498686.445219:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789498686.445239:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885656192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498686.445266:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885656192:12345-0@lo:400:kworker.0 Request processed in 42us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498686.445273:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789498686.445441:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885656576:0@lo:400:kworker.0 00000100:00100000:3.0:1789498686.445451:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885656448:0@lo:400:kworker.0 00000100:00080000:2.0:1789498686.447434:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498686.447443:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498686.447446:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498686.447815:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885656192:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.447834:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885656704:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.447853:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885656320:0@lo:400:kworker.0 00000100:00100000:2.0:1789498686.447863:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885656832:0@lo:400:kworker.0 00000100:00100000:3.0:1789498686.448699:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498686.448714:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885656960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498686.448791:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498686.448849:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885656960 00000100:00100000:3.0:1789498686.448866:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885656960 00000100:00100000:3.0:1789498686.448915:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498686.448924:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885656960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498686.448967:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498686.449015:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885656960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498686.449022:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498686.449073:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885656960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789498686.891528:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498687.915524:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498687.979772:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885657088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498687.979876:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498687.980591:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885657088 00000100:00100000:3.0:1789498687.980604:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885657088 00000100:00100000:3.0:1789498687.980670:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498687.980681:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885657088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498687.980775:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498687.980846:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885657088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498687.980853:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498687.982864:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885657088:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789498688.519800:0:17324:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498688.519810:0:17324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498688.519863:0:17324:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498688.519869:0:17324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498688.939853:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498689.005717:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498689.005729:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498689.005766:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498689.005772:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498689.948554:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498689.948656:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498689.948702:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498689.948761:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864713472 00000100:00100000:0.0:1789498689.948773:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864713472 00000100:00100000:0.0:1789498689.948829:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:0.0:1789498689.948839:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864713472:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498689.948931:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864713472:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498689.948939:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:2.0:1789498689.956487:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498689.956536:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864713728 00000100:00100000:2.0:1789498689.956546:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864713728 00000100:00100000:2.0:1789498689.956614:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:2.0:1789498689.956626:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864713728:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498689.956722:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864713728:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498689.956743:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00080000:2.0:1789498689.956769:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498689.960986:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864713600 00000100:00100000:3.0:1789498689.961007:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864713600 00000100:00100000:3.0:1789498689.961120:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864713856 00000100:00100000:3.0:1789498689.961124:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864713856 00000100:00100000:3.0:1789498689.961345:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:3.0:1789498689.961356:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864713600:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498689.961464:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864713600:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 110us (12922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498689.961486:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:3.0:1789498689.961503:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:3.0:1789498689.961509:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864713856:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498689.961534:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864713856:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (12832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498689.961541:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00080000:2.0:1789498689.962012:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789498689.969148:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498690.765883:0:17375:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498690.765893:0:17375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498690.765940:0:17375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498690.765948:0:17375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498690.988512:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498691.564024:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885657216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498691.564163:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498691.564449:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885657216 00000100:00100000:3.0:1789498691.564459:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885657216 00000100:00100000:3.0:1789498691.564544:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498691.564557:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885657216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498691.564610:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498691.564754:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885657216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498691.564762:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789498691.565509:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498691.565533:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885657728:0@lo:400:kworker.0 00000100:00100000:0.0:1789498691.565581:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498691.565755:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885657216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498691.565781:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789498691.565786:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885657344:0@lo:400:kworker.0 00000100:00100000:0.0:1789498691.565821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498691.565851:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885657856:0@lo:400:kworker.0 00000100:00100000:0.0:1789498691.565877:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498691.565908:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885657344 00000100:00100000:0.0:1789498691.565913:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885657344 00000100:00100000:0.0:1789498691.565955:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789498691.565965:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885657344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498691.566075:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885657472:0@lo:400:kworker.0 00000100:00100000:2.0:1789498691.566864:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498691.566909:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498691.566917:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885657600:0@lo:400:kworker.0 00000100:00100000:2.0:1789498691.566951:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498691.567383:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885657472 00000100:00100000:3.0:1789498691.567392:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885657472 00000100:00100000:3.0:1789498691.567454:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789498691.567464:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885657472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498691.567531:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885657472:12345-0@lo:400:kworker.0 Request processed in 69us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498691.567539:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789498691.567565:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885657728 00000100:00100000:3.0:1789498691.567569:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885657728 00000100:00100000:3.0:1789498691.567599:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885657856 00000100:00100000:3.0:1789498691.567603:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885657856 00000100:00100000:3.0:1789498691.567618:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885657600 00000100:00100000:2.0:1789498691.567757:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498691.567767:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885657728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498691.567815:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885657728:12345-0@lo:400:kworker.0 Request processed in 50us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498691.567822:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498691.567845:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789498691.567851:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885657856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498691.567881:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885657856:12345-0@lo:400:kworker.0 Request processed in 31us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498691.567887:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789498691.568592:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885657344:12345-0@lo:400:kworker.0 Request processed in 2627us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498691.568602:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789498691.568792:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498691.568798:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498691.568846:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885657344:0@lo:400:kworker.0 00000100:00100000:1.0:1789498691.568879:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885657856:0@lo:400:kworker.0 00000100:00100000:1.0:1789498691.568892:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885657728:0@lo:400:kworker.0 00000100:00100000:1.0:1789498691.568936:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885657472:0@lo:400:kworker.0 00000100:00100000:3.0:1789498691.569061:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885657600 00000100:00100000:3.0:1789498691.569128:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498691.569461:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885657600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498691.569536:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885657600:12345-0@lo:400:kworker.0 Request processed in 401us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498691.569543:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789498691.570334:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885657600:0@lo:400:kworker.0 00010000:00010000:3.0:1789498692.016464:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498692.849455:0:17426:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498692.849468:0:17426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498692.849517:0:17426:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498692.849524:0:17426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498693.042853:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498693.100507:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885657984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498693.100588:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498693.100993:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885657984 00000100:00100000:2.0:1789498693.101003:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885657984 00000100:00100000:2.0:1789498693.101084:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789498693.101128:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885657984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498693.101169:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789498693.101252:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498693.102738:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885657984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1607us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498693.102751:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789498693.102869:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885657984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498694.068281:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498694.938488:0:17478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498694.938501:0:17478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498694.938552:0:17478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1789498694.938559:0:17478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498695.062884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498695.062940:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498695.062977:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864714240 00000100:00100000:3.0:1789498695.062989:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864714240 00000100:00100000:3.0:1789498695.063059:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:3.0:1789498695.063069:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864714240:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498695.063175:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864714240:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 107us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498695.063183:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00080000:3.0:1789498695.063207:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498695.063387:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864713984 00000100:00100000:1.0:1789498695.063392:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864713984 00000100:00100000:1.0:1789498695.063428:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:1.0:1789498695.063436:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864713984:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498695.063473:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864713984:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498695.063479:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:3.0:1789498695.064642:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498695.064747:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498695.064775:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864714112 00000100:00100000:3.0:1789498695.064782:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864714112 00000100:00100000:3.0:1789498695.064868:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864714368 00000100:00100000:3.0:1789498695.064871:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864714368 00000100:00100000:3.0:1789498695.064899:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:3.0:1789498695.064907:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864714112:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498695.064978:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864714112:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 72us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498695.064985:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:3.0:1789498695.065001:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:3.0:1789498695.065008:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864714368:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498695.065033:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864714368:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498695.065039:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00080000:3.0:1789498695.065057:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498695.083378:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498696.108269:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498696.683583:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498696.683619:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885658112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498696.683714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498696.683792:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885658112 00000100:00100000:3.0:1789498696.683801:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885658112 00000100:00100000:3.0:1789498696.683860:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789498696.683868:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885658112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498696.683915:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498696.683968:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885658112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498696.683975:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789498696.684000:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498696.684037:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885658112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498696.684489:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885658240:0@lo:400:kworker.0 00000100:00100000:1.0:1789498696.684531:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498696.684581:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885658752:0@lo:400:kworker.0 00000100:00100000:1.0:1789498696.684610:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498696.684631:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498696.684636:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885658368:0@lo:400:kworker.0 00000100:00100000:1.0:1789498696.684663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498696.684704:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885658624:0@lo:400:kworker.0 00000100:00100000:1.0:1789498696.684732:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498696.684751:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498696.684756:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885658496:0@lo:400:kworker.0 00000100:00100000:1.0:1789498696.684777:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498696.684849:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885658240 00000100:00100000:2.0:1789498696.684855:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885658240 00000100:00100000:2.0:1789498696.684896:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789498696.684904:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885658240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498696.684954:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885658240:12345-0@lo:400:kworker.0 Request processed in 51us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498696.684961:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789498696.685085:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885658240:0@lo:400:kworker.0 00000100:00100000:3.0:1789498696.685218:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885658752 00000100:00100000:3.0:1789498696.685223:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885658752 00000100:00100000:3.0:1789498696.685265:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885658624 00000100:00100000:3.0:1789498696.685268:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885658624 00000100:00100000:3.0:1789498696.685283:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885658496 00000100:00100000:3.0:1789498696.685286:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885658496 00000100:00100000:3.0:1789498696.685299:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789498696.685306:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885658752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498696.685352:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885658752:12345-0@lo:400:kworker.0 Request processed in 47us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498696.685359:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789498696.685371:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789498696.685377:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885658624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498696.685410:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885658624:12345-0@lo:400:kworker.0 Request processed in 34us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498696.685416:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789498696.685428:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789498696.685433:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885658496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498696.685459:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885658496:12345-0@lo:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498696.685465:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789498696.685481:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885658368 00000100:00100000:3.0:1789498696.685485:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885658368 00000100:00100000:3.0:1789498696.685513:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498696.685519:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885658368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498696.685549:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885658368:12345-0@lo:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498696.685579:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498696.685622:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885658496:0@lo:400:kworker.0 00000100:00100000:3.0:1789498696.685634:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885658624:0@lo:400:kworker.0 00000100:00100000:3.0:1789498696.685663:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885658368:0@lo:400:kworker.0 00000100:00100000:3.0:1789498696.685673:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885658752:0@lo:400:kworker.0 00000100:00080000:2.0:1789498696.687084:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498696.687126:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789498697.070045:0:17529:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498697.070057:0:17529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498697.070139:0:17529:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498697.070145:0:17529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498697.132273:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498698.157802:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498698.219773:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885658880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498698.219869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498698.219990:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885658880 00000100:00100000:3.0:1789498698.220000:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885658880 00000100:00080000:2.0:1789498698.220670:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498698.221146:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789498698.221166:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885658880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498698.221223:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498698.221310:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885658880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498698.221318:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789498698.221449:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885658880:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789498699.073836:0:17580:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498699.073848:0:17580:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498699.073895:0:17580:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498699.073901:0:17580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498699.182217:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498699.243455:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498699.243467:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498699.243644:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789498699.243652:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498700.182451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498700.182585:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498700.182626:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498700.182668:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498700.182706:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864714624 00000100:00100000:0.0:1789498700.182711:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864714880 00000100:00100000:3.0:1789498700.182716:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864714624 00000100:00100000:0.0:1789498700.182718:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864714880 00000100:00100000:2.0:1789498700.182789:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864714752 00000100:00100000:3.0:1789498700.182806:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:2.0:1789498700.182809:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864714752 00000100:00100000:2.0:1789498700.182864:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:2.0:1789498700.182873:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864714752:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498700.182968:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864714752:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 96us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498700.182976:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00080000:2.0:1789498700.182998:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498700.183004:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498700.184173:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864714496 00000100:00100000:1.0:1789498700.184184:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864714496 00000100:00100000:1.0:1789498700.184243:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:1.0:1789498700.184253:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864714496:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498700.184316:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864714496:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 65us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498700.184323:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:0.0:1789498700.192114:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:0.0:1789498700.192131:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864714880:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498700.192258:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864714880:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 131us (9586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498700.192266:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:3.0:1789498700.193445:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864714624:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498700.193522:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864714624:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 10706us (10894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498700.193546:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00010000:00010000:0.0:1789498700.203354:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498701.176442:0:17632:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498701.176452:0:17632:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498701.186632:0:17632:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789498701.186647:0:17632:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498701.232960:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498701.803446:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885659008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498701.803553:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498701.805716:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885659008 00000100:00100000:2.0:1789498701.805732:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885659008 00000100:00100000:2.0:1789498701.805813:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498701.805824:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885659008:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789498701.805852:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789498701.805869:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498701.805956:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885659008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498701.805963:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789498701.806279:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885659136:0@lo:400:kworker.0 00000100:00100000:1.0:1789498701.806330:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498701.806377:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885659136 00000100:00100000:1.0:1789498701.806396:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885659136 00000100:00100000:1.0:1789498701.806426:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789498701.806432:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885659136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498701.806494:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885659136:12345-0@lo:400:kworker.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498701.806501:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789498701.806548:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885659136:0@lo:400:kworker.0 00000100:00100000:2.0:1789498701.806582:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885659008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498701.806713:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885659264:0@lo:400:kworker.0 00000100:00100000:0.0:1789498701.806746:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498701.806770:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498701.806776:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885659392:0@lo:400:kworker.0 00000100:00100000:0.0:1789498701.806802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498701.806829:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885659264 00000100:00100000:0.0:1789498701.806833:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885659264 00000100:00100000:0.0:1789498701.806869:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789498701.806876:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885659264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498701.806911:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885659264:12345-0@lo:400:kworker.0 Request processed in 35us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498701.806917:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789498701.806942:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885659264:0@lo:400:kworker.0 00000100:00100000:2.0:1789498701.807286:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885659520:0@lo:400:kworker.0 00000100:00100000:2.0:1789498701.807317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498701.807345:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498701.807350:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885659648:0@lo:400:kworker.0 00000100:00100000:2.0:1789498701.807373:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498701.807450:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885659392 00000100:00100000:0.0:1789498701.807455:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885659392 00000100:00100000:0.0:1789498701.807498:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885659520 00000100:00100000:0.0:1789498701.807502:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885659520 00000100:00100000:0.0:1789498701.807517:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885659648 00000100:00100000:0.0:1789498701.807527:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885659648 00000100:00100000:0.0:1789498701.807549:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789498701.807557:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885659392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498701.807606:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885659392:12345-0@lo:400:kworker.0 Request processed in 50us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498701.807614:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789498701.807627:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498701.807634:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885659520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498701.807666:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885659520:12345-0@lo:400:kworker.0 Request processed in 33us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498701.807673:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498701.807685:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498701.807691:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885659648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498701.807717:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885659648:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498701.807723:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498701.807754:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885659392:0@lo:400:kworker.0 00000100:00100000:2.0:1789498701.807902:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885659648:0@lo:400:kworker.0 00000100:00100000:2.0:1789498701.807913:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885659520:0@lo:400:kworker.0 00000100:00080000:1.0:1789498701.808006:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498701.808011:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789498702.252752:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498703.281562:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498703.284129:0:17683:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498703.284141:0:17683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498703.284194:0:17683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498703.284200:0:17683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498703.341307:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885659776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498703.341392:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498703.341592:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885659776 00000100:00100000:3.0:1789498703.341601:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885659776 00000100:00100000:3.0:1789498703.341673:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498703.341685:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885659776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498703.341728:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498703.341782:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885659776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498703.341789:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789498703.341870:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498703.341920:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885659776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498704.303182:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498705.294583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498705.294626:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498705.294660:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498705.294687:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498705.294716:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864715136 00000100:00100000:0.0:1789498705.294733:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864715136 00000100:00100000:0.0:1789498705.294799:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864715392 00000100:00100000:0.0:1789498705.294803:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864715392 00000100:00100000:0.0:1789498705.294827:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:0.0:1789498705.294839:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864715136:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498705.294921:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864715136:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498705.294927:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:0.0:1789498705.294944:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:0.0:1789498705.294950:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864715392:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498705.294976:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864715392:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498705.294983:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:2.0:1789498705.295082:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864715008 00000100:00100000:2.0:1789498705.295115:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864715008 00000100:00100000:2.0:1789498705.295144:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 142 00000100:00100000:2.0:1789498705.295152:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864715008:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498705.295181:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864715008:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498705.295188:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 142 00000100:00080000:1.0:1789498705.295268:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498705.295476:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864715264 00000100:00100000:3.0:1789498705.295482:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864715264 00000100:00100000:3.0:1789498705.295533:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:3.0:1789498705.295541:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864715264:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498705.295574:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864715264:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498705.295581:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00080000:1.0:1789498705.295668:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789498705.323425:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498705.534215:0:17734:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498705.534225:0:17734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498705.534272:0:17734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1789498705.534290:0:17734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498706.347667:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498706.923547:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498706.923574:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885659904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498706.923659:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498706.923736:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885659904 00000100:00100000:3.0:1789498706.923755:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885659904 00000100:00100000:3.0:1789498706.923816:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498706.923824:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885659904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498706.923878:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498706.923927:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885659904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498706.923934:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789498706.923958:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498706.923996:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885659904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498706.924901:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885660032:0@lo:400:kworker.0 00000100:00100000:3.0:1789498706.924954:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498706.924986:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885660544:0@lo:400:kworker.0 00000100:00100000:3.0:1789498706.925012:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498706.925033:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498706.925038:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885660160:0@lo:400:kworker.0 00000100:00100000:3.0:1789498706.925059:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498706.925107:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885660416:0@lo:400:kworker.0 00000100:00100000:3.0:1789498706.925148:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498706.925165:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498706.925170:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885660288:0@lo:400:kworker.0 00000100:00100000:3.0:1789498706.925190:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498706.925216:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885660032 00000100:00100000:3.0:1789498706.925222:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885660032 00000100:00100000:3.0:1789498706.925262:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789498706.925270:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885660032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498706.925622:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885660160 00000100:00100000:1.0:1789498706.925627:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885660160 00000100:00100000:1.0:1789498706.925668:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789498706.925675:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885660160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498706.925734:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885660160:12345-0@lo:400:kworker.0 Request processed in 59us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498706.925740:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789498706.925761:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885660544 00000100:00100000:1.0:1789498706.925774:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885660544 00000100:00100000:1.0:1789498706.925804:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885660416 00000100:00100000:1.0:1789498706.925806:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885660416 00000100:00100000:1.0:1789498706.925819:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885660288 00000100:00100000:1.0:1789498706.925822:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885660288 00000100:00100000:1.0:1789498706.925836:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789498706.925842:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885660544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498706.925876:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885660544:12345-0@lo:400:kworker.0 Request processed in 34us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498706.925882:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789498706.925892:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789498706.925897:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885660416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498706.925926:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885660416:12345-0@lo:400:kworker.0 Request processed in 29us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498706.925932:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789498706.925942:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789498706.925946:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885660288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498706.925971:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885660288:12345-0@lo:400:kworker.0 Request processed in 23us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498706.925976:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789498706.926003:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498706.926008:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498706.926035:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885660288:0@lo:400:kworker.0 00000100:00100000:1.0:1789498706.926047:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885660416:0@lo:400:kworker.0 00000100:00100000:1.0:1789498706.926074:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885660160:0@lo:400:kworker.0 00000100:00100000:1.0:1789498706.926084:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885660544:0@lo:400:kworker.0 00000100:00100000:3.0:1789498706.926445:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885660032:12345-0@lo:400:kworker.0 Request processed in 1175us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498706.926473:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789498706.933503:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885660032:0@lo:400:kworker.0 00010000:00010000:3.0:1789498707.372450:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498707.724587:0:17785:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498707.724597:0:17785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498707.724646:0:17785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498707.724652:0:17785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498708.395455:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498708.459776:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885660672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498708.459864:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498708.460201:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885660672 00000100:00100000:3.0:1789498708.460222:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885660672 00000100:00100000:3.0:1789498708.460295:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498708.460306:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885660672:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789498708.460470:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789498708.460580:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498708.460706:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885660672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 401us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498708.460714:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498708.466166:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885660672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498709.421644:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498709.486720:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498709.486730:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498709.486764:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498709.486771:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:0.0:1789498709.747777:0:17837:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498709.747787:0:17837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498709.747837:0:17837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1789498709.747842:0:17837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789498710.417353:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498710.417399:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498710.417525:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864715520 00000100:00100000:1.0:1789498710.417538:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864715520 00000100:00100000:1.0:1789498710.417610:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:1.0:1789498710.417620:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864715520:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498710.417705:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864715520:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 86us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498710.417713:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:0.0:1789498710.417935:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498710.422879:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498710.423869:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864715776 00000100:00100000:3.0:1789498710.423886:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864715776 00000100:00100000:3.0:1789498710.423992:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:3.0:1789498710.424003:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864715776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498710.424120:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864715776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 118us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498710.424127:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00080000:0.0:1789498710.425117:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498710.430763:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864715648 00000100:00100000:2.0:1789498710.430785:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864715648 00000100:00080000:0.0:1789498710.430991:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498710.432812:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864715904 00000100:00100000:2.0:1789498710.432829:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864715904 00000100:00080000:0.0:1789498710.432980:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498710.433147:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1789498710.433163:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864715648:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498710.433275:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864715648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 117us (15874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498710.433284:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1789498710.433318:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:1.0:1789498710.433324:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864715904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498710.433349:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864715904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (15414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498710.433356:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00010000:00010000:3.0:1789498710.443435:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498711.469017:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498711.807572:0:17888:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498711.807582:0:17888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498711.807635:0:17888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789498711.807640:0:17888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498712.044519:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885661056:0@lo:400:kworker.0 00000100:00100000:2.0:1789498712.044610:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498712.044671:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498712.044677:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885661184:0@lo:400:kworker.0 00000100:00100000:2.0:1789498712.044703:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498712.044740:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885661184 00000100:00100000:2.0:1789498712.044750:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885661184 00000100:00100000:2.0:1789498712.044803:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789498712.044812:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885661184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498712.044865:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885661184:12345-0@lo:400:kworker.0 Request processed in 53us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498712.044871:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789498712.044913:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885661184:0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.045820:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885660800:0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.045876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498712.045912:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885661312:0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.045936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498712.045961:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789498712.045968:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885660928:0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.046007:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498712.046026:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885661440:0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.046047:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498712.046438:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885661312 00000100:00100000:3.0:1789498712.046446:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885661312 00000100:00100000:3.0:1789498712.046490:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885661440 00000100:00100000:3.0:1789498712.046493:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885661440 00000100:00100000:3.0:1789498712.046514:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789498712.046522:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885661312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.046645:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885661312:12345-0@lo:400:kworker.0 Request processed in 123us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498712.046652:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789498712.046671:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789498712.046677:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885661440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.046706:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885661440:12345-0@lo:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498712.046712:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789498712.046727:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498712.046753:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885661440:0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.046765:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885661312:0@lo:400:kworker.0 00000100:00100000:2.0:1789498712.047137:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885661568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498712.047174:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498712.047441:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885661568 00000100:00100000:3.0:1789498712.047446:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885661568 00000100:00100000:3.0:1789498712.047493:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498712.047500:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885661568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498712.047533:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498712.047646:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885660800 00000100:00100000:0.0:1789498712.047652:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885660800 00000100:00100000:0.0:1789498712.047682:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789498712.047689:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885660800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498712.047734:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885660800:12345-0@lo:400:kworker.0 Request processed in 45us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498712.047741:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1789498712.047877:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498712.047910:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885661568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 410us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498712.047927:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498712.047964:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885660800:0@lo:400:kworker.0 00000100:00100000:1.0:1789498712.048130:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885661056 00000100:00100000:1.0:1789498712.048135:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885661056 00000100:00100000:1.0:1789498712.048162:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885660928 00000100:00100000:1.0:1789498712.048166:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885660928 00000100:00100000:1.0:1789498712.048202:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789498712.048305:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498712.048409:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789498712.048417:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885660928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498712.048468:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885660928:12345-0@lo:400:kworker.0 Request processed in 52us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498712.048474:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789498712.048534:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885660928:0@lo:400:kworker.0 00000100:00100000:1.0:1789498712.048634:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885661056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498712.048674:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885661056:12345-0@lo:400:kworker.0 Request processed in 465us (4064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498712.048681:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789498712.050514:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885661568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498712.050532:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885661056:0@lo:400:kworker.0 00010000:00010000:3.0:1789498712.491346:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498713.518412:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498713.584086:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498713.584131:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885661696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498713.584468:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498713.584667:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885661696 00000100:00100000:2.0:1789498713.584676:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885661696 00000100:00100000:2.0:1789498713.584733:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498713.584752:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885661696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498713.584792:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498713.584854:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885661696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498713.584862:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789498713.585070:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885661696:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498713.864869:0:17939:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498713.864882:0:17939:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498713.864931:0:17939:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1789498713.864938:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498714.541110:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498715.538809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498715.538859:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498715.538890:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498715.538918:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498715.538950:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864716160 00000100:00100000:0.0:1789498715.538963:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864716160 00000100:00100000:0.0:1789498715.539021:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864716416 00000100:00100000:0.0:1789498715.539024:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864716416 00000100:00100000:0.0:1789498715.539065:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:0.0:1789498715.539076:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864716160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498715.539205:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864716160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 129us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498715.539223:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:0.0:1789498715.539258:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1789498715.539265:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864716416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498715.539295:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864716416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498715.539303:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1789498715.539323:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864716032 00000100:00100000:0.0:1789498715.539327:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864716032 00000100:00100000:0.0:1789498715.539352:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 146 00000100:00100000:0.0:1789498715.539360:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864716032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498715.539386:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864716032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498715.539393:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 146 00000100:00100000:0.0:1789498715.539421:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864716288 00000100:00100000:0.0:1789498715.539424:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864716288 00000100:00100000:0.0:1789498715.539455:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:0.0:1789498715.539462:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864716288:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498715.539492:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864716288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498715.539499:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00080000:0.0:1789498715.539515:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498715.539520:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498715.563346:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498715.963903:0:17991:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498715.963913:0:17991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498715.963959:0:17991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789498715.963964:0:17991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498716.587284:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498717.169802:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885661952:0@lo:400:kworker.0 00000100:00100000:0.0:1789498717.169913:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498717.170588:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885662080:0@lo:400:kworker.0 00000100:00100000:3.0:1789498717.170638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498717.188625:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885661952 00000100:00100000:1.0:1789498717.188647:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885661952 00000100:00100000:1.0:1789498717.188722:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885662080 00000100:00100000:1.0:1789498717.188726:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885662080 00000100:00100000:1.0:1789498717.188758:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789498717.188768:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885661952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498717.189559:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885661952:12345-0@lo:400:kworker.0 Request processed in 788us (19641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498717.189571:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789498717.189601:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789498717.189612:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885662080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498717.189666:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885662080:12345-0@lo:400:kworker.0 Request processed in 59us (19027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498717.189672:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789498717.189703:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885662208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498717.189749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498717.194574:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885661952:0@lo:400:kworker.0 00000100:00100000:3.0:1789498717.194580:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885662080:0@lo:400:kworker.0 00000100:00100000:3.0:1789498717.194598:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885662592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498717.194599:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885662464:0@lo:400:kworker.0 00000100:00080000:1.0:1789498717.196332:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498717.196364:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498717.196403:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885662208 00000100:00100000:1.0:1789498717.196417:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885662208 00000100:00100000:1.0:1789498717.197374:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789498717.197390:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885662208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498717.198645:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498717.198652:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498717.198728:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789498717.198742:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885661824:0@lo:400:kworker.0 00000100:00100000:0.0:1789498717.198781:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498717.198802:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885662336:0@lo:400:kworker.0 00000100:00100000:3.0:1789498717.199584:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885662592 00000100:00100000:3.0:1789498717.199594:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885662592 00000100:00100000:3.0:1789498717.199649:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498717.199659:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885662592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498717.199960:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498717.200021:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885662592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 363us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498717.200030:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789498717.200211:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885661824 00000100:00100000:3.0:1789498717.200216:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885661824 00000100:00100000:3.0:1789498717.200249:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789498717.200256:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885661824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498717.200567:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885661824:12345-0@lo:400:kworker.0 Request processed in 311us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498717.200574:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789498717.201609:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885662592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498717.201942:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885662464 00000100:00100000:3.0:1789498717.201949:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885662464 00000100:00100000:3.0:1789498717.202002:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789498717.202010:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885662464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498717.203213:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885662208:12345-0@lo:400:kworker.0 Request processed in 5822us (13457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498717.203226:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789498717.203232:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885662464:12345-0@lo:400:kworker.0 Request processed in 1220us (4579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498717.203242:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789498717.205235:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498717.205308:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885662208:0@lo:400:kworker.0 00000100:00100000:0.0:1789498717.207274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498717.207375:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885662464:0@lo:400:kworker.0 00000100:00100000:0.0:1789498717.207411:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885661824:0@lo:400:kworker.0 00000100:00100000:2.0:1789498717.207950:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885662336 00000100:00100000:2.0:1789498717.207962:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885662336 00000100:00100000:2.0:1789498717.208312:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789498717.208324:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885662336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498717.208428:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885662336:12345-0@lo:400:kworker.0 Request processed in 106us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498717.208436:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789498717.209829:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498717.210402:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885662336:0@lo:400:kworker.0 00010000:00010000:1.0:1789498717.611653:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498718.348120:0:18042:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498718.348130:0:18042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498718.351658:0:18042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789498718.351682:0:18042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498718.635425:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498718.700835:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885662720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498718.700934:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498718.701132:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885662720 00000100:00100000:3.0:1789498718.701142:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885662720 00000100:00100000:3.0:1789498718.701214:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789498718.701244:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885662720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498718.701291:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498718.701341:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885662720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498718.701348:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789498718.702172:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885662720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498719.660467:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498719.725386:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498719.725396:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498719.725698:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:1.0:1789498719.725704:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1789498720.516983:0:18093:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498720.516993:0:18093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498720.517034:0:18093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:3.0:1789498720.517041:0:18093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498720.654335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498720.654389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498720.654457:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864716672 00000100:00100000:3.0:1789498720.654467:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864716672 00000100:00100000:3.0:1789498720.654540:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:3.0:1789498720.654551:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864716672:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498720.654714:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864716672:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 165us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498720.654723:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00080000:3.0:1789498720.654747:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498720.657324:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498720.657372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498720.657411:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864716928 00000100:00100000:2.0:1789498720.657421:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864716928 00000100:00100000:2.0:1789498720.657488:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1789498720.657499:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864716928:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498720.657581:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864716928:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498720.657589:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1789498720.657613:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864716800 00000100:00100000:2.0:1789498720.657617:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864716800 00000100:00100000:2.0:1789498720.657647:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1789498720.657653:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864716800:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498720.657693:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864716800:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498720.657699:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00080000:3.0:1789498720.658267:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498720.658273:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498720.663754:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864716544 00000100:00100000:0.0:1789498720.663773:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864716544 00000100:00100000:0.0:1789498720.663850:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 148 00000100:00100000:0.0:1789498720.663862:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864716544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498720.663960:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864716544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 100us (9569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498720.663967:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 148 00010000:00010000:1.0:1789498720.683327:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498721.715206:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498722.284336:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885662976:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.284422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498722.284472:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885663488:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.284501:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498722.284528:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789498722.284534:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885662848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498722.284560:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498722.284577:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885663360:0@lo:400:kworker.0 00000100:00100000:3.0:1789498722.285947:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885662976 00000100:00100000:3.0:1789498722.286857:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885662976 00000100:00100000:3.0:1789498722.286942:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789498722.286953:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885662976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498722.287164:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885662976:12345-0@lo:400:kworker.0 Request processed in 212us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498722.287173:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789498722.287230:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885663488 00000100:00100000:3.0:1789498722.287237:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885663488 00000100:00100000:3.0:1789498722.287279:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789498722.287286:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885663488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498722.287325:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885663488:12345-0@lo:400:kworker.0 Request processed in 40us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498722.287332:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789498722.287351:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885662848 00000100:00100000:3.0:1789498722.287356:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885662848 00000100:00100000:3.0:1789498722.287386:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789498722.287393:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885662848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498722.287426:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498722.287460:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885662848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (2899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498722.287466:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789498722.287896:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498722.287950:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885662976:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.288180:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885663488:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.288212:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885662848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498722.288237:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885663104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.288268:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498722.288290:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885663616:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.288313:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498722.288336:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498722.288343:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885663232:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.288364:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498722.288401:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885663360 00000100:00100000:1.0:1789498722.288406:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885663360 00000100:00100000:1.0:1789498722.288434:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885663616 00000100:00100000:1.0:1789498722.288437:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885663616 00000100:00100000:1.0:1789498722.288455:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789498722.288462:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885663360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.288504:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885663360:12345-0@lo:400:kworker.0 Request processed in 42us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498722.288512:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789498722.288526:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789498722.288531:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885663616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.288561:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885663616:12345-0@lo:400:kworker.0 Request processed in 31us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498722.288567:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789498722.290078:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498722.290111:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498722.291880:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885663104 00000100:00100000:1.0:1789498722.291894:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885663104 00000100:00100000:2.0:1789498722.291963:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885663232 00000100:00100000:2.0:1789498722.291968:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885663232 00000100:00100000:2.0:1789498722.292014:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789498722.292025:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885663104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.292115:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789498722.292123:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885663232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.293047:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885663232:12345-0@lo:400:kworker.0 Request processed in 921us (4677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498722.293058:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789498722.293174:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885663232:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.293188:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885663104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.293201:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885663616:0@lo:400:kworker.0 00000100:00100000:1.0:1789498722.293418:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885663360:0@lo:400:kworker.0 00000100:00080000:3.0:1789498722.293746:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498722.294293:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885663104:12345-0@lo:400:kworker.0 Request processed in 2267us (6020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498722.294305:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000040:00080000:1.0:1789498722.539565:0:18147:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498722.539576:0:18147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498722.539618:0:18147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:1.0:1789498722.539623:0:18147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498722.731418:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498723.757235:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498723.825736:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885663744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498723.825826:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498723.827240:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885663744 00000100:00100000:0.0:1789498723.827254:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885663744 00000100:00100000:0.0:1789498723.827310:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789498723.827320:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885663744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498723.827494:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498723.830672:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885663744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3232us (4724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498723.830712:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789498723.834320:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885663744:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498724.599563:0:18198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498724.599573:0:18198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498724.599615:0:18198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:3.0:1789498724.599622:0:18198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498724.782762:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498725.784169:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498725.784223:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498725.784266:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498725.784304:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498725.784346:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864717312 00000100:00100000:3.0:1789498725.784360:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864717312 00000100:00100000:2.0:1789498725.784364:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864717184 00000100:00100000:2.0:1789498725.784370:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864717184 00000100:00100000:2.0:1789498725.784431:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864717440 00000100:00100000:3.0:1789498725.784435:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:2.0:1789498725.784437:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864717440 00000100:00100000:3.0:1789498725.784450:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864717312:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498725.784469:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:2.0:1789498725.784478:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864717184:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498725.784548:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864717312:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 103us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498725.784571:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:0.0:1789498725.784575:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:0.0:1789498725.784587:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864717440:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:3.0:1789498725.784596:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498725.784602:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498725.784657:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864717056 00000100:00100000:1.0:1789498725.784663:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864717056 00000100:00100000:1.0:1789498725.784698:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 150 00000100:00100000:1.0:1789498725.784706:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864717056:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498725.791869:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864717184:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 7373us (7583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498725.791887:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:0.0:1789498725.792465:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864717440:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 7876us (8155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498725.792475:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:1.0:1789498725.799058:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864717056:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 14339us (14890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498725.799121:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 150 00010000:00010000:3.0:1789498725.803435:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498726.759484:0:18249:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498726.759495:0:18249:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498726.759605:0:18249:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:2.0:1789498726.759610:0:18249:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498726.830317:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498727.403367:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885663872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498727.403443:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498727.403626:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885664000:0@lo:400:kworker.0 00000100:00100000:1.0:1789498727.403664:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498727.404228:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885663872 00000100:00100000:2.0:1789498727.404239:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885663872 00000100:00100000:2.0:1789498727.404312:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789498727.404323:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885663872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498727.404364:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789498727.405167:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498727.405407:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885664000 00000100:00100000:1.0:1789498727.405416:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885664000 00000100:00100000:1.0:1789498727.405453:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789498727.405462:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885664000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498727.405540:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885664000:12345-0@lo:400:kworker.0 Request processed in 79us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498727.405547:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789498727.405609:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885664000:0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.407384:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885664256:0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.407443:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498727.407477:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498727.407483:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885664128:0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.407531:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498727.407563:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885664128 00000100:00100000:3.0:1789498727.407568:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885664128 00000100:00100000:3.0:1789498727.407630:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789498727.407638:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885664128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.407688:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885664128:12345-0@lo:400:kworker.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498727.407695:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789498727.407744:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885664128:0@lo:400:kworker.0 00000100:00080000:3.0:1789498727.407762:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498727.407781:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885664512:0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.407808:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498727.407828:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498727.407833:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885664384:0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.407855:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498727.407897:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885664256 00000100:00100000:3.0:1789498727.407901:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885664256 00000100:00100000:3.0:1789498727.408305:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885664512 00000100:00100000:3.0:1789498727.408324:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885664512 00000100:00100000:3.0:1789498727.408348:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885664384 00000100:00100000:3.0:1789498727.408351:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885664384 00000100:00100000:3.0:1789498727.408368:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789498727.408374:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885664256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.408417:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885664256:12345-0@lo:400:kworker.0 Request processed in 43us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498727.408423:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789498727.408436:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789498727.408442:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885664512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.408470:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885664512:12345-0@lo:400:kworker.0 Request processed in 28us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498727.408476:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789498727.408488:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789498727.408494:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885664384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498727.408519:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885664384:12345-0@lo:400:kworker.0 Request processed in 26us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498727.408525:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789498727.408554:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885664256:0@lo:400:kworker.0 00000100:00100000:1.0:1789498727.411798:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885664384:0@lo:400:kworker.0 00000100:00100000:1.0:1789498727.411832:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885664512:0@lo:400:kworker.0 00000100:00100000:2.0:1789498727.412486:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885663872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8163us (9039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498727.412517:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789498727.412653:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498727.412722:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885663872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789498727.852125:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498728.771875:0:18300:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498728.771886:0:18300:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498728.771926:0:18300:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:2.0:1789498728.771932:0:18300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498728.876166:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498728.948038:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498728.948062:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885664640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498728.948152:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498728.948217:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885664640 00000100:00100000:3.0:1789498728.948225:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885664640 00000100:00100000:3.0:1789498728.948402:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498728.948424:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885664640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498728.948466:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498728.948516:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885664640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498728.948523:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498728.948574:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885664640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498729.900841:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498729.963609:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498729.963620:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498729.963952:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 1 00000040:00080000:2.0:1789498729.963971:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1789498730.646545:0:18352:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498730.646556:0:18352:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498730.647387:0:18352:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498730.647400:0:18352:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498730.900992:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498730.901036:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498730.901072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498730.901121:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498730.901183:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864717696 00000100:00100000:2.0:1789498730.901194:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864717696 00000100:00100000:2.0:1789498730.901256:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864717952 00000100:00100000:2.0:1789498730.901260:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864717952 00000100:00100000:2.0:1789498730.901286:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:2.0:1789498730.901297:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864717696:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498730.901378:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864717696:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498730.901386:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:2.0:1789498730.901416:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:2.0:1789498730.901423:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864717952:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498730.901454:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864717952:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498730.901479:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00080000:2.0:1789498730.901498:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498730.901977:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864717824 00000100:00100000:3.0:1789498730.901984:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864717824 00000100:00100000:1.0:1789498730.902526:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864717568 00000100:00100000:1.0:1789498730.902533:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864717568 00000100:00100000:1.0:1789498730.902585:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 152 00000100:00100000:1.0:1789498730.902594:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864717568:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498730.902647:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864717568:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 53us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498730.902654:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 152 00000100:00100000:0.0:1789498730.905142:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:0.0:1789498730.905171:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864717824:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498730.905252:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864717824:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 98us (4213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498730.905260:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00080000:3.0:1789498730.905821:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789498730.924704:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498731.958900:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498732.523325:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498732.523355:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885664768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498732.523432:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498732.523671:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885664768 00000100:00100000:3.0:1789498732.523683:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885664768 00000100:00100000:3.0:1789498732.523749:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789498732.523762:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885664768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498732.523807:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498732.523865:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885664768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498732.523873:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789498732.523933:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498732.524343:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885664768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498732.525066:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885665280:0@lo:400:kworker.0 00000100:00100000:1.0:1789498732.525153:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498732.525187:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498732.525193:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885665152:0@lo:400:kworker.0 00000100:00100000:1.0:1789498732.525217:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498732.525245:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885665280 00000100:00100000:1.0:1789498732.525250:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885665280 00000100:00100000:1.0:1789498732.525290:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885665152 00000100:00100000:1.0:1789498732.525293:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885665152 00000100:00100000:1.0:1789498732.525311:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789498732.525317:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885665280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498732.525358:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885665280:12345-0@lo:400:kworker.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498732.525365:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789498732.525379:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789498732.525385:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885665152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498732.525410:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885665152:12345-0@lo:400:kworker.0 Request processed in 26us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498732.525415:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789498732.525440:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498732.525462:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885665152:0@lo:400:kworker.0 00000100:00100000:1.0:1789498732.525473:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885665280:0@lo:400:kworker.0 00000100:00100000:0.0:1789498732.525597:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885664896:0@lo:400:kworker.0 00000100:00100000:0.0:1789498732.525638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498732.525677:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885665408:0@lo:400:kworker.0 00000100:00100000:0.0:1789498732.525702:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498732.525721:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498732.525726:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885665024:0@lo:400:kworker.0 00000100:00100000:0.0:1789498732.525751:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498732.525781:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885665024 00000100:00100000:0.0:1789498732.525792:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885665024 00000100:00100000:0.0:1789498732.525827:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789498732.525834:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885665024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498732.525877:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885665024:12345-0@lo:400:kworker.0 Request processed in 43us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498732.525883:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789498732.525923:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885665024:0@lo:400:kworker.0 00000100:00100000:0.0:1789498732.525944:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885665408 00000100:00100000:0.0:1789498732.525947:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885665408 00000100:00100000:0.0:1789498732.525969:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789498732.525975:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885665408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498732.526007:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885665408:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498732.526013:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789498732.526035:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885665408:0@lo:400:kworker.0 00000100:00100000:1.0:1789498732.526253:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885664896 00000100:00100000:1.0:1789498732.526259:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885664896 00000100:00100000:1.0:1789498732.526290:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789498732.526297:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885664896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498732.526335:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885664896:12345-0@lo:400:kworker.0 Request processed in 40us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498732.526343:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1789498732.526371:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498732.526375:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498732.526389:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885664896:0@lo:400:kworker.0 00000040:00080000:1.0:1789498732.744566:0:18404:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498732.744578:0:18404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498732.745131:0:18404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498732.745141:0:18404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498732.977001:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498734.007661:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498734.059259:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498734.059285:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885665536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498734.059361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498734.059469:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885665536 00000100:00100000:3.0:1789498734.059478:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885665536 00000100:00100000:3.0:1789498734.059544:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789498734.059554:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885665536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498734.059597:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498734.059645:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885665536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498734.059653:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789498734.059675:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498734.059713:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885665536:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789498734.693083:0:18455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498734.693112:0:18455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498734.695879:0:18455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498734.695902:0:18455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498735.019381:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498736.014814:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498736.014870:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498736.014907:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498736.014938:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498736.014967:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864718208 00000100:00100000:0.0:1789498736.014979:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864718208 00000100:00100000:0.0:1789498736.015041:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864718464 00000100:00100000:0.0:1789498736.015044:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864718464 00000100:00100000:0.0:1789498736.015071:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:0.0:1789498736.015081:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864718208:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498736.015198:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864718208:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 118us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498736.015216:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:0.0:1789498736.015235:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:0.0:1789498736.015242:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864718464:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498736.015271:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864718464:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498736.015277:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:0.0:1789498736.015295:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864718080 00000100:00100000:0.0:1789498736.015298:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864718080 00000100:00100000:0.0:1789498736.015323:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:0.0:1789498736.015329:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864718080:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498736.015616:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864718080:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 285us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498736.015624:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:0.0:1789498736.015656:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864718336 00000100:00100000:0.0:1789498736.015660:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864718336 00000100:00100000:0.0:1789498736.015701:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:0.0:1789498736.015708:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864718336:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498736.015754:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864718336:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 47us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498736.015761:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00080000:0.0:1789498736.015778:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498736.015783:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789498736.043404:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498736.763491:0:18508:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498736.763502:0:18508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498736.764062:0:18508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498736.764070:0:18508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498737.067349:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498737.643491:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498737.643526:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885665664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498737.643616:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498737.644231:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885665664 00000100:00100000:1.0:1789498737.644244:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885665664 00000100:00100000:1.0:1789498737.644333:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789498737.644343:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885665664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498737.644395:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498737.644471:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885665664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498737.644500:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789498737.644668:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498737.644718:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885665664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498737.645042:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885665920:0@lo:400:kworker.0 00000100:00100000:0.0:1789498737.645106:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498737.645147:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498737.645153:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885666048:0@lo:400:kworker.0 00000100:00100000:0.0:1789498737.645184:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498737.645220:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885665920 00000100:00100000:0.0:1789498737.645226:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885665920 00000100:00100000:0.0:1789498737.645279:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789498737.645289:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885665920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789498737.645485:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498737.645497:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885665792:0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.645534:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498737.645564:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885666304:0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.645590:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498737.645614:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498737.645620:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885666176:0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.645644:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498737.645673:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885666048 00000100:00100000:2.0:1789498737.645677:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885666048 00000100:00100000:2.0:1789498737.645709:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885666304 00000100:00100000:2.0:1789498737.645712:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885666304 00000100:00100000:2.0:1789498737.645730:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885666176 00000100:00100000:2.0:1789498737.645732:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885666176 00000100:00100000:2.0:1789498737.645748:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789498737.645755:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885666048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.645812:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885666048:12345-0@lo:400:kworker.0 Request processed in 56us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498737.645830:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789498737.645847:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789498737.645853:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885666304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.645900:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885666304:12345-0@lo:400:kworker.0 Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498737.645907:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789498737.645921:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789498737.645928:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885666176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.645957:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885666176:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498737.645962:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789498737.645985:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498737.646014:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885666048:0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.646041:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885666176:0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.646052:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885666304:0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.646143:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885665792 00000100:00100000:2.0:1789498737.646147:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885665792 00000100:00100000:2.0:1789498737.646175:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789498737.646181:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885665792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498737.646214:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885665792:12345-0@lo:400:kworker.0 Request processed in 33us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498737.646219:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789498737.646258:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885665792:0@lo:400:kworker.0 00000100:00100000:0.0:1789498737.648602:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885665920:12345-0@lo:400:kworker.0 Request processed in 3305us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498737.648617:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498737.648790:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885665920:0@lo:400:kworker.0 00010000:00010000:1.0:1789498738.105762:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498738.805999:0:18560:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498738.806015:0:18560:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498738.806629:0:18560:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498738.806642:0:18560:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498739.116386:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498739.179406:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498739.179418:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498739.179871:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498739.179881:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498739.180474:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885666432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498739.180552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498739.180774:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885666432 00000100:00100000:1.0:1789498739.180800:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885666432 00000100:00100000:1.0:1789498739.180903:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789498739.180912:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885666432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498739.180960:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498739.181014:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885666432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498739.181020:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789498739.181064:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498739.181823:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885666432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498740.139351:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498740.749889:0:18611:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498740.749904:0:18611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498740.750741:0:18611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498740.750760:0:18611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498741.138451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498741.138506:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498741.138563:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498741.138628:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498741.138680:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864718720 00000100:00100000:3.0:1789498741.138736:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864718720 00000100:00100000:3.0:1789498741.138828:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864718976 00000100:00100000:3.0:1789498741.138832:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864718976 00000100:00100000:3.0:1789498741.138860:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:3.0:1789498741.138892:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864718720:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498741.139190:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864718720:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 299us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498741.139199:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:3.0:1789498741.139220:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 110 00000100:00100000:3.0:1789498741.139227:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864718976:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498741.139252:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864718976:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498741.139259:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 110 00000100:00080000:3.0:1789498741.139306:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498741.139432:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864718848 00000100:00100000:1.0:1789498741.139439:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864718848 00000100:00100000:1.0:1789498741.139494:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:1.0:1789498741.139503:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864718848:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498741.139538:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864718848:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498741.139544:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:0.0:1789498741.139635:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864718592 00000100:00100000:0.0:1789498741.139641:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864718592 00000100:00100000:0.0:1789498741.139689:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 156 00000100:00100000:0.0:1789498741.139696:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864718592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498741.139726:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864718592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498741.139732:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 156 00000100:00080000:3.0:1789498741.140236:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789498741.163410:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498742.192532:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498742.766438:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885666560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498742.766537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498742.766636:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885666560 00000100:00100000:1.0:1789498742.766659:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885666560 00000100:00100000:1.0:1789498742.766752:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789498742.766764:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885666560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498742.766819:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498742.766877:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885666560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498742.766885:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789498742.766914:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498742.767436:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885666560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498742.768277:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885666944:0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.768361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498742.768404:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498742.768410:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885667072:0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.768435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498742.768470:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885666944 00000100:00100000:3.0:1789498742.768477:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885666944 00000100:00100000:3.0:1789498742.768531:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885667072 00000100:00100000:3.0:1789498742.768534:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885667072 00000100:00100000:3.0:1789498742.768569:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789498742.768579:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885666944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.768638:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885666944:12345-0@lo:400:kworker.0 Request processed in 60us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498742.768647:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789498742.768674:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789498742.768680:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885667072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.768709:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885667072:12345-0@lo:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498742.768715:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789498742.768755:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498742.768788:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885667072:0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.768798:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885666944:0@lo:400:kworker.0 00000100:00100000:1.0:1789498742.770916:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885666688:0@lo:400:kworker.0 00000100:00100000:1.0:1789498742.771015:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498742.771111:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885667200:0@lo:400:kworker.0 00000100:00100000:1.0:1789498742.771144:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498742.771179:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498742.771187:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885666816:0@lo:400:kworker.0 00000100:00100000:1.0:1789498742.771216:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498742.771263:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885666816 00000100:00100000:1.0:1789498742.771274:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885666816 00000100:00100000:1.0:1789498742.771354:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789498742.771366:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885666816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498742.771434:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885666816:12345-0@lo:400:kworker.0 Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498742.771442:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789498742.771497:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885666816:0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.771827:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885666688 00000100:00100000:3.0:1789498742.771833:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885666688 00000100:00100000:3.0:1789498742.771874:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789498742.771882:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885666688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.771935:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885666688:12345-0@lo:400:kworker.0 Request processed in 54us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498742.771942:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1789498742.771973:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498742.771989:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885667200 00000100:00100000:3.0:1789498742.771992:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885667200 00000100:00100000:3.0:1789498742.772027:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789498742.772039:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885667200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.772074:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885667200:12345-0@lo:400:kworker.0 Request processed in 36us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498742.772080:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789498742.772124:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498742.772145:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885666688:0@lo:400:kworker.0 00000100:00100000:3.0:1789498742.772159:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885667200:0@lo:400:kworker.0 00000040:00080000:3.0:1789498743.035736:0:18662:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498743.035754:0:18662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498743.039315:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498743.039340:0:18662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789498743.215619:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498744.237726:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498744.299551:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498744.299581:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885667328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498744.299676:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498744.299883:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885667328 00000100:00100000:0.0:1789498744.299895:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885667328 00000100:00100000:0.0:1789498744.299983:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789498744.299994:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885667328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498744.300202:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789498744.300298:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498744.300425:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885667328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 432us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498744.300455:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789498744.300532:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885667328:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498745.207146:0:18715:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498745.207157:0:18715:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498745.207681:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498745.207703:0:18715:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498745.267870:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498746.253980:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498746.254047:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498746.254075:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864719104 00000100:00100000:1.0:1789498746.254116:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864719104 00000100:00100000:1.0:1789498746.254193:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 158 00000100:00100000:1.0:1789498746.254205:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864719104:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498746.254246:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864719232 00000100:00100000:3.0:1789498746.254251:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864719232 00000100:00080000:0.0:1789498746.254413:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498746.254458:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864719104:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498746.259973:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:3.0:1789498746.260257:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864719232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498746.260439:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864719232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 205us (6390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498746.266404:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 158 00000100:00100000:3.0:1789498746.270210:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:0.0:1789498746.275809:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498746.275968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498746.276072:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864719360 00000100:00100000:1.0:1789498746.276084:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864719360 00000100:00100000:3.0:1789498746.276115:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864719488 00000100:00100000:3.0:1789498746.276120:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864719488 00000100:00100000:1.0:1789498746.276245:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:1.0:1789498746.276267:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864719360:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498746.276355:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864719360:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 101us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498746.276363:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:2.0:1789498746.279614:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 115 00000100:00100000:2.0:1789498746.279629:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864719488:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498746.279731:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864719488:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 106us (3932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498746.279738:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 115 00010000:00010000:3.0:1789498746.285122:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498746.294155:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498746.294168:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789498747.189275:0:18766:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498747.189287:0:18766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498747.189818:0:18766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498747.189826:0:18766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498747.309661:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498747.883407:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498747.883435:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885667456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498747.883523:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498747.885327:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885667968:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.885396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498747.885438:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789498747.885444:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885667584:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.885476:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498747.885503:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885668096:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.885527:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498747.885558:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885667840:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.885596:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498747.885647:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498747.885653:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885667712:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.885683:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498747.885718:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885667968 00000100:00100000:2.0:1789498747.885727:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885667968 00000100:00100000:2.0:1789498747.885780:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885668096 00000100:00100000:2.0:1789498747.885784:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885668096 00000100:00100000:2.0:1789498747.885800:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885667840 00000100:00100000:2.0:1789498747.885802:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885667840 00000100:00100000:2.0:1789498747.885818:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789498747.885826:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885667968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.885881:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885667968:12345-0@lo:400:kworker.0 Request processed in 55us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498747.885888:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789498747.885905:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789498747.885910:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885668096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.885938:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885668096:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498747.885943:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789498747.885954:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789498747.885960:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885667840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.886006:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885667840:12345-0@lo:400:kworker.0 Request processed in 45us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498747.886022:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789498747.886040:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885667584 00000100:00100000:2.0:1789498747.886043:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885667584 00000100:00100000:2.0:1789498747.886067:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789498747.886072:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885667584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.886142:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885667584:12345-0@lo:400:kworker.0 Request processed in 70us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498747.886150:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789498747.886185:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885667712 00000100:00100000:2.0:1789498747.886189:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885667712 00000100:00100000:2.0:1789498747.886220:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789498747.886226:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885667712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.886256:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885667712:12345-0@lo:400:kworker.0 Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498747.886262:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789498747.886304:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885667712:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.886315:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885667840:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.886344:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885667584:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.886353:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885668096:0@lo:400:kworker.0 00000100:00100000:2.0:1789498747.886362:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885667968:0@lo:400:kworker.0 00000100:00080000:0.0:1789498747.886913:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498747.886919:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498747.888500:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885667456 00000100:00100000:1.0:1789498747.888514:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885667456 00000100:00100000:1.0:1789498747.888605:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789498747.888615:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885667456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498747.888665:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498747.888760:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885667456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (5238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498747.888768:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789498747.888826:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498747.888868:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885667456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789498748.331387:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498749.201534:0:18818:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498749.201546:0:18818:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498749.202225:0:18818:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498749.202234:0:18818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498749.355935:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498749.420326:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498749.420392:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885668224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498749.420474:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789498749.420686:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498749.420691:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498749.421272:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498749.421284:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498749.422756:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885668224 00000100:00100000:1.0:1789498749.422774:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885668224 00000100:00100000:1.0:1789498749.422859:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789498749.422872:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885668224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498749.423083:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498749.423189:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885668224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 320us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498749.423197:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789498749.423331:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498749.423378:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885668224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789498750.379471:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498751.213688:0:18870:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498751.213700:0:18870:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498751.214561:0:18870:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498751.214571:0:18870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498751.373891:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498751.373938:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498751.374024:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498751.374062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498751.374136:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864719744 00000100:00100000:1.0:1789498751.374157:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864719744 00000100:00100000:1.0:1789498751.374220:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864720000 00000100:00100000:1.0:1789498751.374224:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864720000 00000100:00100000:1.0:1789498751.374246:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:1.0:1789498751.374254:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864719744:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498751.374319:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864719744:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 65us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498751.374326:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:1.0:1789498751.374345:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:1.0:1789498751.374351:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864720000:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498751.374376:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864720000:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498751.374412:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00080000:1.0:1789498751.374429:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498751.376141:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864719616 00000100:00100000:2.0:1789498751.376157:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864719616 00000100:00100000:2.0:1789498751.376222:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 160 00000100:00100000:2.0:1789498751.376231:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864719616:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498751.376298:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864719616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498751.376305:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 160 00000100:00100000:0.0:1789498751.377421:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864719872 00000100:00100000:0.0:1789498751.377433:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864719872 00000100:00100000:0.0:1789498751.377558:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:0.0:1789498751.377568:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864719872:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498751.377667:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864719872:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 100us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498751.377675:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00080000:1.0:1789498751.378157:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789498751.404023:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498752.430128:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498753.007148:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498753.007181:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885668352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498753.007268:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498753.007339:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885668352 00000100:00100000:3.0:1789498753.007348:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885668352 00000100:00100000:3.0:1789498753.007410:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789498753.007420:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885668352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498753.007466:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498753.007512:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885668352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498753.007521:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789498753.007554:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498753.007604:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885668352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498753.010313:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885668480:0@lo:400:kworker.0 00000100:00100000:3.0:1789498753.010392:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498753.012013:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885668480 00000100:00100000:2.0:1789498753.012026:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885668480 00000100:00100000:2.0:1789498753.012086:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789498753.015483:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885668480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.019046:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885668608:0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.019153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498753.019201:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498753.019207:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885668992:0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.019244:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498753.019273:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885668864:0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.019296:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498753.019314:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498753.019319:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885668736:0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.019338:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498753.019368:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885668992 00000100:00100000:0.0:1789498753.019376:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885668992 00000100:00100000:0.0:1789498753.019430:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885668864 00000100:00100000:0.0:1789498753.019433:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885668864 00000100:00100000:0.0:1789498753.019446:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885668736 00000100:00100000:0.0:1789498753.019448:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885668736 00000100:00100000:0.0:1789498753.019464:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789498753.019475:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885668992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.019532:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885668992:12345-0@lo:400:kworker.0 Request processed in 59us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498753.019539:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789498753.019571:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789498753.019913:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885668864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.019951:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885668864:12345-0@lo:400:kworker.0 Request processed in 374us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498753.019959:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789498753.019973:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789498753.019979:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885668736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.020004:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885668736:12345-0@lo:400:kworker.0 Request processed in 26us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498753.020022:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789498753.020203:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885668992:0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.020234:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885668736:0@lo:400:kworker.0 00000100:00100000:0.0:1789498753.020244:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885668864:0@lo:400:kworker.0 00000100:00100000:1.0:1789498753.021241:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885668608 00000100:00100000:1.0:1789498753.021252:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885668608 00000100:00100000:1.0:1789498753.021306:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498753.021315:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885668608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498753.021386:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885668608:12345-0@lo:400:kworker.0 Request processed in 72us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498753.021393:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789498753.021484:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885668608:0@lo:400:kworker.0 00000100:00100000:2.0:1789498753.021998:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885668480:12345-0@lo:400:kworker.0 Request processed in 6526us (11602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498753.022008:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1789498753.022173:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498753.022180:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498753.024722:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885668480:0@lo:400:kworker.0 00000040:00080000:2.0:1789498753.172704:0:18921:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498753.172827:0:18921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498753.174822:0:18921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498753.174841:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498753.451372:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498754.475418:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498754.544409:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885669120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498754.544514:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498754.544628:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885669120 00000100:00100000:3.0:1789498754.544638:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885669120 00000100:00100000:3.0:1789498754.544700:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789498754.544709:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885669120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498754.544752:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498754.547341:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885669120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2621us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498754.547355:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789498754.547475:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885669120:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498755.125967:0:18972:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498755.125977:0:18972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498755.128935:0:18972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498755.128960:0:18972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498755.499379:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498756.494832:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498756.494881:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498756.494917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498756.494944:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498756.495012:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864720256 00000100:00100000:3.0:1789498756.495026:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864720256 00000100:00100000:3.0:1789498756.495115:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864720512 00000100:00100000:3.0:1789498756.495119:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864720512 00000100:00100000:3.0:1789498756.495147:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:3.0:1789498756.495157:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864720256:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498756.495241:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864720256:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498756.495250:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:3.0:1789498756.495269:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:3.0:1789498756.495351:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864720512:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498756.495381:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864720512:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498756.495387:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:3.0:1789498756.495407:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864720128 00000100:00100000:3.0:1789498756.495411:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864720128 00000100:00100000:3.0:1789498756.495438:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 162 00000100:00100000:3.0:1789498756.495444:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864720128:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498756.495468:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864720128:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498756.495473:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 162 00000100:00080000:1.0:1789498756.495879:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498756.498665:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864720384 00000100:00100000:0.0:1789498756.498679:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864720384 00000100:00100000:0.0:1789498756.498852:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:0.0:1789498756.498862:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864720384:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498756.498944:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864720384:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (3998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498756.498951:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00080000:1.0:1789498756.500948:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789498756.524599:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498757.162541:0:19023:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498757.162551:0:19023:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498757.163072:0:19023:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498757.163080:0:19023:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498757.548625:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498758.123513:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885669248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498758.123594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498758.124004:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885669248 00000100:00100000:3.0:1789498758.124014:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885669248 00000100:00100000:3.0:1789498758.124076:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789498758.124085:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885669248:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789498758.124218:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789498758.124243:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498758.124300:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885669248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498758.124308:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789498758.124388:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885669248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498758.124952:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498758.124962:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885669376:0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.125001:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498758.125036:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885669376 00000100:00100000:2.0:1789498758.125040:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885669376 00000100:00100000:2.0:1789498758.125067:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789498758.125073:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885669376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.125213:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885669376:12345-0@lo:400:kworker.0 Request processed in 139us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498758.125220:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789498758.125396:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885669376:0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.125431:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885669504:0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.125659:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498758.125703:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498758.125709:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885669632:0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.125732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498758.127167:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885669632 00000100:00100000:2.0:1789498758.127179:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885669632 00000100:00100000:2.0:1789498758.127231:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789498758.127239:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885669632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.127304:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885669632:12345-0@lo:400:kworker.0 Request processed in 66us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498758.127311:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789498758.127356:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885669632:0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.127412:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885669760:0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.127552:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498758.127593:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885669760 00000100:00100000:2.0:1789498758.127598:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885669760 00000100:00100000:2.0:1789498758.127633:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789498758.127640:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885669760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.127681:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885669760:12345-0@lo:400:kworker.0 Request processed in 41us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498758.127700:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1789498758.127720:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498758.127739:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885669760:0@lo:400:kworker.0 00000100:00100000:0.0:1789498758.127881:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885669504 00000100:00100000:0.0:1789498758.127886:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885669504 00000100:00100000:1.0:1789498758.137614:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885669888:0@lo:400:kworker.0 00000100:00100000:1.0:1789498758.137717:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498758.138253:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789498758.138279:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885669504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498758.138372:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885669504:12345-0@lo:400:kworker.0 Request processed in 97us (12712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498758.138389:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1789498758.138659:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498758.138719:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885669504:0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.150221:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885669888 00000100:00100000:2.0:1789498758.150240:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885669888 00000100:00100000:2.0:1789498758.150343:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1789498758.150353:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498758.150355:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885669888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498758.150450:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885669888:12345-0@lo:400:kworker.0 Request processed in 98us (12732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498758.150467:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789498758.150512:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98649d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885669888:0@lo:400:kworker.0 00010000:00010000:3.0:1789498758.572370:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498759.170587:0:19075:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498759.170599:0:19075:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498759.171679:0:19075:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498759.171695:0:19075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498759.595369:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498759.659860:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498759.659875:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498759.660453:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498759.660462:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498759.661039:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498759.661064:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885670016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498759.661178:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498759.661322:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885670016 00000100:00100000:3.0:1789498759.661331:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885670016 00000100:00100000:3.0:1789498759.661386:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789498759.661396:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885670016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498759.661448:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498759.661520:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885670016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498759.661528:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789498759.661733:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885670016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498760.619584:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498761.133392:0:19126:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498761.133422:0:19126:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498761.134382:0:19126:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498761.134410:0:19126:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498761.627286:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498761.627341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498761.627385:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498761.627501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498761.627558:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864720768 00000100:00100000:2.0:1789498761.627571:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864720768 00000100:00100000:2.0:1789498761.627643:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864721024 00000100:00100000:2.0:1789498761.627647:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864721024 00000100:00100000:2.0:1789498761.627673:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 129 00000100:00100000:2.0:1789498761.627685:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864720768:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498761.627789:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864720768:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 105us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498761.627817:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 129 00000100:00100000:2.0:1789498761.627839:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:2.0:1789498761.627846:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864721024:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:1.0:1789498761.628186:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498761.628410:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864720896 00000100:00100000:0.0:1789498761.628416:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864720896 00000100:00100000:0.0:1789498761.628472:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:0.0:1789498761.628480:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864720896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:1.0:1789498761.628537:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498761.628560:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864721024:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 714us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498761.628567:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:3.0:1789498761.629579:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864720640 00000100:00100000:3.0:1789498761.629592:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864720640 00000100:00100000:3.0:1789498761.629645:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:3.0:1789498761.629654:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864720640:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498761.631312:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864720896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 2820us (3913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498761.631328:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:3.0:1789498761.631691:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864720640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 2034us (4418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498761.631722:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 164 00010000:00010000:3.0:1789498761.643823:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498762.670267:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498763.244434:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885670144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498763.244546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498763.244739:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885670144 00000100:00100000:3.0:1789498763.244752:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885670144 00000100:00100000:3.0:1789498763.244840:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789498763.244852:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885670144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498763.244904:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498763.244976:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885670144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498763.244983:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789498763.245049:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885670144:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789498763.245683:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498763.245841:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885670656:0@lo:400:kworker.0 00000100:00100000:1.0:1789498763.245953:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885670272:0@lo:400:kworker.0 00000100:00100000:1.0:1789498763.246011:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498763.246048:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885670784:0@lo:400:kworker.0 00000100:00100000:1.0:1789498763.246114:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498763.246142:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498763.246148:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885670400:0@lo:400:kworker.0 00000100:00100000:1.0:1789498763.246176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498763.246222:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885670784 00000100:00100000:1.0:1789498763.246250:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885670784 00000100:00100000:1.0:1789498763.246310:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789498763.246319:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885670784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498763.246381:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885670784:12345-0@lo:400:kworker.0 Request processed in 63us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498763.246389:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789498763.246412:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885670400 00000100:00100000:1.0:1789498763.246416:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885670400 00000100:00100000:1.0:1789498763.246450:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789498763.246457:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885670400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498763.246490:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885670400:12345-0@lo:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498763.246496:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789498763.246532:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498763.246536:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498763.246561:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885670400:0@lo:400:kworker.0 00000100:00100000:1.0:1789498763.246570:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885670784:0@lo:400:kworker.0 00000100:00100000:3.0:1789498763.247144:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498763.247182:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498763.247192:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885670528:0@lo:400:kworker.0 00000100:00100000:3.0:1789498763.247218:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498763.247629:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885670272 00000100:00100000:2.0:1789498763.247638:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885670272 00000100:00100000:2.0:1789498763.247680:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789498763.247688:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885670272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498763.247743:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885670272:12345-0@lo:400:kworker.0 Request processed in 56us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498763.247750:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789498763.247782:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885670656 00000100:00100000:2.0:1789498763.247786:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885670656 00000100:00100000:2.0:1789498763.247820:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885670528 00000100:00100000:2.0:1789498763.247824:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885670528 00000100:00100000:2.0:1789498763.247841:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789498763.248188:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789498763.248199:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885670528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498763.248247:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885670528:12345-0@lo:400:kworker.0 Request processed in 52us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498763.248254:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789498763.248426:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498763.248464:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885670272:0@lo:400:kworker.0 00000100:00100000:3.0:1789498763.248679:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885670528:0@lo:400:kworker.0 00000100:00100000:2.0:1789498763.248755:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885670656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498763.248816:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885670656:12345-0@lo:400:kworker.0 Request processed in 968us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498763.248824:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789498763.249034:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885670656:0@lo:400:kworker.0 00000040:00080000:3.0:1789498763.343648:0:19177:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498763.343662:0:19177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498763.345476:0:19177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498763.345495:0:19177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498763.691779:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498764.715360:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498764.779774:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885670912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498764.779897:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498764.780238:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885670912 00000100:00100000:1.0:1789498764.780249:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885670912 00000100:00100000:1.0:1789498764.780314:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789498764.780324:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885670912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498764.780390:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498764.780449:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885670912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498764.780458:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498764.780493:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885670912:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789498765.268466:0:19228:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498765.268479:0:19228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498765.269299:0:19228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498765.269313:0:19228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498765.739474:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498766.748947:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498766.749004:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498766.749050:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498766.749196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498766.749244:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864721280 00000100:00100000:0.0:1789498766.749273:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864721280 00000100:00100000:0.0:1789498766.749383:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864721536 00000100:00100000:0.0:1789498766.749387:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864721536 00000100:00100000:0.0:1789498766.749416:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:0.0:1789498766.749427:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864721280:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498766.749526:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864721280:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 100us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498766.749550:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:0.0:1789498766.749572:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:0.0:1789498766.749578:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864721536:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498766.749602:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864721536:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498766.749608:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:0.0:1789498766.749628:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864721152 00000100:00100000:0.0:1789498766.749632:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864721152 00000100:00100000:0.0:1789498766.749658:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 166 00000100:00100000:0.0:1789498766.749667:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864721152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498766.749692:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864721152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498766.749698:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 166 00000100:00100000:0.0:1789498766.749735:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864721408 00000100:00100000:0.0:1789498766.749738:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864721408 00000100:00100000:0.0:1789498766.749773:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:0.0:1789498766.749780:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864721408:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498766.749806:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864721408:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498766.749811:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00080000:0.0:1789498766.749827:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498766.749833:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498766.770491:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498767.453935:0:19280:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498767.453955:0:19280:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498767.454520:0:19280:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498767.454533:0:19280:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498767.790437:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498768.363515:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885671040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498768.363630:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498768.363916:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885671040 00000100:00100000:3.0:1789498768.363928:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885671040 00000100:00100000:3.0:1789498768.364020:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789498768.364031:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885671040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498768.364086:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498768.364171:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885671040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498768.364180:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789498768.364292:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498768.364342:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885671040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498768.364645:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885671424:0@lo:400:kworker.0 00000100:00100000:2.0:1789498768.364687:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498768.364715:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498768.364721:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885671296:0@lo:400:kworker.0 00000100:00100000:2.0:1789498768.364751:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498768.364846:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885671296 00000100:00100000:1.0:1789498768.364853:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885671296 00000100:00100000:1.0:1789498768.364907:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789498768.364917:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885671296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.364968:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885671296:12345-0@lo:400:kworker.0 Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498768.364976:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789498768.365001:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885671168:0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365033:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498768.365054:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885671680:0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498768.365123:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498768.365129:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885671552:0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365154:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498768.365179:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885671424 00000100:00100000:1.0:1789498768.365183:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885671424 00000100:00100000:1.0:1789498768.365210:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885671680 00000100:00100000:1.0:1789498768.365213:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885671680 00000100:00100000:1.0:1789498768.365246:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885671552 00000100:00100000:1.0:1789498768.365249:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885671552 00000100:00100000:1.0:1789498768.365262:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789498768.365281:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885671424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365316:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885671424:12345-0@lo:400:kworker.0 Request processed in 48us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498768.365323:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789498768.365336:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789498768.365342:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885671680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365373:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885671680:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498768.365379:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789498768.365389:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789498768.365395:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885671552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365419:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885671552:12345-0@lo:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498768.365425:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789498768.365459:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885671296:0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365471:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885671424:0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365512:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885671552:0@lo:400:kworker.0 00000100:00100000:1.0:1789498768.365520:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885671680:0@lo:400:kworker.0 00000100:00100000:0.0:1789498768.365611:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885671168 00000100:00100000:0.0:1789498768.365615:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885671168 00000100:00100000:0.0:1789498768.365655:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789498768.365662:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885671168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498768.365705:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885671168:12345-0@lo:400:kworker.0 Request processed in 43us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498768.365712:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789498768.365746:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885671168:0@lo:400:kworker.0 00000100:00080000:2.0:1789498768.365954:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498768.365960:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789498768.813165:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498769.431561:0:19331:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498769.431573:0:19331:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498769.432135:0:19331:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498769.432153:0:19331:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498769.836281:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498769.899427:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498769.899476:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885671808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498769.899557:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498769.900007:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885671808 00000100:00100000:1.0:1789498769.900018:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885671808 00000100:00100000:1.0:1789498769.900076:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789498769.900114:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885671808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498769.900158:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498769.900215:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885671808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498769.900222:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789498769.900279:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885671808:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498769.900791:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498769.900798:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498769.901419:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498769.901439:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498770.859324:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498771.296577:0:19382:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498771.296589:0:19382:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498771.297504:0:19382:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498771.297517:0:19382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498771.854799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498771.854922:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498771.855400:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864721664 00000100:00100000:0.0:1789498771.855413:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864721664 00000100:00100000:0.0:1789498771.855477:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 168 00000100:00100000:0.0:1789498771.855486:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864721664:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498771.855564:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864721664:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498771.855571:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 168 00000100:00100000:1.0:1789498771.856058:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864721792 00000100:00100000:1.0:1789498771.856064:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864721792 00000100:00100000:1.0:1789498771.856160:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 139 00000100:00100000:1.0:1789498771.856170:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864721792:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498771.856398:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864721792:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 228us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498771.856406:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 139 00000100:00080000:0.0:1789498771.857034:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498771.858026:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498771.858242:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864721920 00000100:00100000:0.0:1789498771.858269:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864721920 00000100:00100000:0.0:1789498771.858345:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:0.0:1789498771.858354:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864721920:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498771.858434:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864721920:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498771.858442:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00080000:2.0:1789498771.858626:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498771.869296:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498771.869408:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864722048 00000100:00100000:0.0:1789498771.869419:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864722048 00000100:00100000:0.0:1789498771.869509:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:0.0:1789498771.869519:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864722048:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498771.869629:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864722048:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498771.869637:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00080000:2.0:1789498771.869746:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498771.883353:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498772.907356:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498773.368312:0:19434:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498773.368323:0:19434:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498773.371009:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498773.371029:0:19434:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498773.483416:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498773.483457:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885671936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498773.483556:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498773.485048:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885671936 00000100:00100000:3.0:1789498773.485082:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885671936 00000100:00100000:3.0:1789498773.485616:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789498773.485629:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885671936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498773.485672:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498773.485987:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885671936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 360us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498773.485995:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789498773.486018:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498773.486202:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885672064:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.486250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498773.486282:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885672576:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.486311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498773.486362:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498773.486377:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885672192:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.486421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498773.486463:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885672064 00000100:00100000:3.0:1789498773.486470:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885672064 00000100:00100000:3.0:1789498773.486508:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789498773.486516:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885672064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.486560:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885672064:12345-0@lo:400:kworker.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498773.486566:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789498773.486601:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885672576 00000100:00100000:3.0:1789498773.486605:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885672576 00000100:00100000:3.0:1789498773.486641:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789498773.486649:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885672576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.486683:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885672576:12345-0@lo:400:kworker.0 Request processed in 36us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498773.486705:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789498773.486729:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885672192 00000100:00100000:3.0:1789498773.486733:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885672192 00000100:00100000:3.0:1789498773.487686:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789498773.487697:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885672192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.487773:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885672192:12345-0@lo:400:kworker.0 Request processed in 77us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498773.487781:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789498773.488021:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498773.488028:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498773.488054:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885672448:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.488117:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498773.488159:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498773.488167:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98573c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885672320:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.488206:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498773.488239:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885672448 00000100:00100000:3.0:1789498773.488247:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885672448 00000100:00100000:3.0:1789498773.488287:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885672320 00000100:00100000:3.0:1789498773.488290:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885672320 00000100:00100000:3.0:1789498773.488310:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789498773.488318:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885672448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.488571:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885672448:12345-0@lo:400:kworker.0 Request processed in 252us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498773.488578:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789498773.488594:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789498773.488600:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885672320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.488648:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885672320:12345-0@lo:400:kworker.0 Request processed in 49us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498773.488654:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1789498773.488674:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498773.488706:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885672320:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.488718:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885672448:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.488818:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885672192:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.488828:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885672064:0@lo:400:kworker.0 00000100:00100000:3.0:1789498773.488841:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885672576:0@lo:400:kworker.0 00000100:00100000:0.0:1789498773.489620:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98573f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885671936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789498773.931402:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498774.955287:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498775.019371:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885672704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498775.019448:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498775.024833:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885672704 00000100:00100000:2.0:1789498775.024914:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885672704 00000100:00100000:2.0:1789498775.025276:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789498775.025285:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885672704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498775.025324:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498775.025395:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885672704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (5947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498775.025402:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789498775.025420:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498775.025455:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885672704:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498775.430531:0:19485:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498775.430542:0:19485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498775.433237:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498775.433260:0:19485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498775.979559:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498776.973547:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498776.973668:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864722304 00000100:00100000:0.0:1789498776.973698:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864722304 00000100:00100000:0.0:1789498776.973852:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:0.0:1789498776.973875:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864722304:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498776.974013:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864722304:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 149us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498776.974022:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00080000:2.0:1789498776.974160:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498776.975508:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498776.975568:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498776.975581:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864722560 00000100:00100000:0.0:1789498776.975606:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864722560 00000100:00100000:0.0:1789498776.975683:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 145 00000100:00100000:0.0:1789498776.975694:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864722560:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:3.0:1789498776.975789:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498776.975852:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864722176 00000100:00100000:2.0:1789498776.975864:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864722176 00000100:00100000:2.0:1789498776.975902:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 170 00000100:00100000:2.0:1789498776.975910:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb29c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864722176:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498776.975978:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864722560:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 285us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498776.975987:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 145 00000100:00100000:2.0:1789498776.979287:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb29c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864722176:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 3362us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498776.979304:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 170 00000100:00100000:0.0:1789498776.986244:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498776.986296:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864722432 00000100:00100000:0.0:1789498776.986308:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864722432 00000100:00100000:0.0:1789498776.986419:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:0.0:1789498776.986431:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864722432:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498776.986513:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864722432:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498776.986520:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00080000:3.0:1789498776.990906:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789498777.005361:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498777.642945:0:19536:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498777.642958:0:19536:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498777.646597:0:19536:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498777.646636:0:19536:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498778.027423:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498778.604119:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498778.608992:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885672960:0@lo:400:kworker.0 00000100:00100000:2.0:1789498778.609131:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498778.609205:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885672832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498778.609235:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498778.609279:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885672960 00000100:00100000:2.0:1789498778.609292:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885672960 00000100:00100000:2.0:1789498778.609369:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789498778.609394:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885672960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498778.609477:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885672960:12345-0@lo:400:kworker.0 Request processed in 85us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498778.609487:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789498778.609530:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885672832 00000100:00100000:2.0:1789498778.609533:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885672832 00000100:00100000:2.0:1789498778.609568:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498778.609573:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885672832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498778.609610:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498778.609637:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885672832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498778.609642:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789498778.609677:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498778.609711:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885672960:0@lo:400:kworker.0 00000100:00100000:2.0:1789498778.609728:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885672832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498778.611599:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885673088:0@lo:400:kworker.0 00000100:00100000:1.0:1789498778.611675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498778.611714:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498778.611718:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885673216:0@lo:400:kworker.0 00000100:00100000:1.0:1789498778.611740:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498778.611784:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885673088 00000100:00100000:1.0:1789498778.611794:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885673088 00000100:00100000:1.0:1789498778.611859:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789498778.611865:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885673088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498778.611929:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885673088:12345-0@lo:400:kworker.0 Request processed in 64us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498778.611935:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789498778.611956:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885673216 00000100:00100000:1.0:1789498778.611959:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885673216 00000100:00100000:1.0:1789498778.611979:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789498778.611984:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885673216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498778.612003:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885673216:12345-0@lo:400:kworker.0 Request processed in 20us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498778.612007:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1789498778.612025:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498778.612238:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885673344:0@lo:400:kworker.0 00000100:00100000:3.0:1789498778.612273:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498778.612308:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498778.612315:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885673472:0@lo:400:kworker.0 00000100:00100000:3.0:1789498778.612341:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498778.612420:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885673344 00000100:00100000:3.0:1789498778.612425:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885673344 00000100:00100000:3.0:1789498778.612460:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885673472 00000100:00100000:3.0:1789498778.612463:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885673472 00000100:00100000:3.0:1789498778.612491:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789498778.612497:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885673344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498778.612538:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885673344:12345-0@lo:400:kworker.0 Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498778.612545:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789498778.612558:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789498778.612565:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885673472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498778.612593:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885673472:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498778.612599:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789498778.612637:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885673472:0@lo:400:kworker.0 00000100:00100000:3.0:1789498778.612647:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885673344:0@lo:400:kworker.0 00000100:00080000:3.0:1789498778.612676:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498778.613939:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885673216:0@lo:400:kworker.0 00000100:00100000:1.0:1789498778.613973:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885673088:0@lo:400:kworker.0 00010000:00010000:1.0:1789498779.052456:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498779.116668:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498779.116683:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498779.117162:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498779.117174:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1789498779.612772:0:19587:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498779.612786:0:19587:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498779.613920:0:19587:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498779.613939:0:19587:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498780.075975:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498780.141651:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885673600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498780.141770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498780.142667:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885673600 00000100:00100000:0.0:1789498780.142684:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885673600 00000100:00100000:0.0:1789498780.142808:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789498780.142822:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885673600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498780.142888:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498780.142979:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885673600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498780.142988:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789498780.143054:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885673600:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789498780.143232:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789498781.100655:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498781.621732:0:19639:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498781.621740:0:19639:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498781.623978:0:19639:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498781.624695:0:19639:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498782.097376:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498782.097435:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498782.097485:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498782.097540:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498782.097574:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864722944 00000100:00100000:3.0:1789498782.097594:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864722816 00000100:00100000:0.0:1789498782.097594:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864722944 00000100:00100000:3.0:1789498782.097606:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864722816 00000100:00100000:2.0:1789498782.097696:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864722688 00000100:00100000:2.0:1789498782.097702:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864722688 00000100:00100000:2.0:1789498782.097760:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 172 00000100:00100000:2.0:1789498782.097773:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864722688:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498782.097869:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864722688:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 99us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498782.097877:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 172 00000100:00100000:2.0:1789498782.097949:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864723072 00000100:00100000:2.0:1789498782.097953:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864723072 00000100:00100000:3.0:1789498782.098013:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 149 00000100:00100000:3.0:1789498782.098032:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864722816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498782.098072:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864722816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 52us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498782.098079:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 149 00000100:00100000:0.0:1789498782.098606:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:0.0:1789498782.098622:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864722944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498782.099064:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864722944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 445us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498782.099072:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:2.0:1789498782.103606:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 150 00000100:00100000:2.0:1789498782.103646:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864723072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:1.0:1789498782.110036:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498782.110057:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498782.110628:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864723072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 6987us (13071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498782.110650:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 150 00010000:00010000:1.0:1789498782.123646:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498783.147270:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498783.679212:0:19690:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498783.679228:0:19690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498783.683045:0:19690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498783.683073:0:19690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789498783.723477:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498783.723529:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885673728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498783.723642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498783.723728:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885673728 00000100:00100000:0.0:1789498783.723738:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885673728 00000100:00100000:0.0:1789498783.723810:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789498783.724010:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885673728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498783.724066:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498783.724157:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885673728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 337us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498783.724165:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789498783.724190:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498783.724234:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885673728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498783.727911:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885673856:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.728066:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498783.728145:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885674368:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.728178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498783.728215:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498783.728222:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885673984:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.728252:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498783.740010:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885674240:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.740149:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498783.740222:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498783.740230:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885674112:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.740255:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498783.740300:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885673856 00000100:00100000:0.0:1789498783.740310:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885673856 00000100:00100000:0.0:1789498783.740376:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789498783.740386:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885673856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.740458:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885673856:12345-0@lo:400:kworker.0 Request processed in 72us (12392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498783.740466:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789498783.740508:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885674368 00000100:00100000:0.0:1789498783.740512:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885674368 00000100:00100000:0.0:1789498783.740552:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885674240 00000100:00100000:0.0:1789498783.740555:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885674240 00000100:00100000:0.0:1789498783.740570:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885674112 00000100:00100000:0.0:1789498783.740572:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885674112 00000100:00100000:0.0:1789498783.740585:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789498783.740591:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885674368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.740630:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885674368:12345-0@lo:400:kworker.0 Request processed in 40us (12451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498783.740648:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789498783.740661:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789498783.740667:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885674240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.740704:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885674240:12345-0@lo:400:kworker.0 Request processed in 37us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498783.740711:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789498783.740723:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789498783.740729:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885674112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.740757:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885674112:12345-0@lo:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498783.740763:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789498783.740797:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885673984 00000100:00100000:0.0:1789498783.740802:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885673984 00000100:00100000:0.0:1789498783.740904:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789498783.740912:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885673984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.740951:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885673984:12345-0@lo:400:kworker.0 Request processed in 40us (12698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498783.740957:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1789498783.741006:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498783.741012:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498783.741048:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885674112:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.741058:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885674240:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.741123:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885673984:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.741134:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885673856:0@lo:400:kworker.0 00000100:00100000:0.0:1789498783.741155:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885674368:0@lo:400:kworker.0 00010000:00010000:3.0:1789498784.173209:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498785.205740:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498785.260071:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885674496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498785.260323:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498785.260447:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885674496 00000100:00100000:1.0:1789498785.260456:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885674496 00000100:00100000:1.0:1789498785.260527:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789498785.260537:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885674496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498785.260608:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498785.260657:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885674496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498785.260665:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1789498785.261291:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498785.261333:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885674496:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789498785.602172:0:19741:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498785.602181:0:19741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498785.602982:0:19741:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498785.602993:0:19741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498786.219334:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498787.216976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498787.217032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498787.217139:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864723328 00000100:00100000:3.0:1789498787.217153:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864723328 00000100:00100000:3.0:1789498787.217246:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:3.0:1789498787.217259:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864723328:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498787.217349:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864723328:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 92us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498787.217357:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:2.0:1789498787.218950:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864723200 00000100:00100000:2.0:1789498787.218964:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864723200 00000100:00100000:2.0:1789498787.219030:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:2.0:1789498787.219039:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864723200:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498787.219133:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864723200:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 94us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498787.219160:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00080000:1.0:1789498787.219279:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498787.219561:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498787.220704:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864723456 00000100:00100000:2.0:1789498787.220717:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864723456 00000100:00100000:2.0:1789498787.220809:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:2.0:1789498787.220820:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864723456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498787.220897:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864723456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498787.220904:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00080000:1.0:1789498787.221029:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498787.226249:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498787.227178:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864723584 00000100:00100000:2.0:1789498787.227192:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864723584 00000100:00100000:2.0:1789498787.227859:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00100000:2.0:1789498787.227871:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864723584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498787.227975:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864723584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 106us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498787.227983:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00080000:1.0:1789498787.237542:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498787.243256:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498787.597319:0:19793:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498787.597332:0:19793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498787.597832:0:19793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498787.597843:0:19793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498788.267352:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498788.843421:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885674624:0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.843529:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498788.843594:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885675136:0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.843627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498788.843663:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789498788.843669:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885674752:0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.843700:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498788.843721:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885675264:0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.843744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498788.843778:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885674880:0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.844717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498788.844767:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885675392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498788.845235:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498788.845265:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498788.845293:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885675008:0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.845323:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498788.845392:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885674624 00000100:00100000:0.0:1789498788.845405:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885674624 00000100:00100000:0.0:1789498788.845468:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789498788.845480:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885674624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.845548:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885674624:12345-0@lo:400:kworker.0 Request processed in 69us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498788.845557:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789498788.845597:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885675136 00000100:00100000:0.0:1789498788.845602:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885675136 00000100:00100000:0.0:1789498788.845640:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885675264 00000100:00100000:0.0:1789498788.845644:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885675264 00000100:00100000:0.0:1789498788.845658:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885675008 00000100:00100000:0.0:1789498788.845661:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885675008 00000100:00100000:0.0:1789498788.845675:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789498788.845681:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885675136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.845720:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885675136:12345-0@lo:400:kworker.0 Request processed in 39us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498788.845726:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789498788.845742:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789498788.845748:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885675264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498788.845781:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885675264:12345-0@lo:400:kworker.0 Request processed in 33us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498788.847141:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789498788.847317:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885674752 00000100:00100000:1.0:1789498788.847329:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885674752 00000100:00100000:1.0:1789498788.847379:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885674880 00000100:00100000:1.0:1789498788.847384:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885674880 00000100:00100000:1.0:1789498788.847414:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789498788.847425:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885674752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498788.847512:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885674752:12345-0@lo:400:kworker.0 Request processed in 89us (3810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498788.847520:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789498788.847534:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789498788.847541:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885674880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498788.847586:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885674880:12345-0@lo:400:kworker.0 Request processed in 46us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498788.847593:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789498788.847614:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885675392 00000100:00100000:1.0:1789498788.847618:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885675392 00000100:00100000:1.0:1789498788.847645:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789498788.847652:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885675392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498788.847709:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498788.847743:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885675392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498788.847750:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789498788.847768:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498788.847773:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498788.847776:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498788.849569:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885675392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498788.849597:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885674880:0@lo:400:kworker.0 00000100:00100000:2.0:1789498788.856179:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789498788.856224:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885675008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498788.856381:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885675008:12345-0@lo:400:kworker.0 Request processed in 182us (11055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498788.856391:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789498788.856564:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885674752:0@lo:400:kworker.0 00000100:00100000:2.0:1789498788.856581:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885675264:0@lo:400:kworker.0 00000100:00100000:2.0:1789498788.856593:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885674624:0@lo:400:kworker.0 00000100:00100000:2.0:1789498788.856632:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885675136:0@lo:400:kworker.0 00000100:00100000:1.0:1789498788.857167:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885675008:0@lo:400:kworker.0 00010000:00010000:3.0:1789498789.292502:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498789.368204:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498789.368222:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498789.368929:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498789.368945:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1789498789.903395:0:19844:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498789.903409:0:19844:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498789.904540:0:19844:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498789.904557:0:19844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498790.316223:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498790.379582:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885675520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498790.379704:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498790.379836:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885675520 00000100:00100000:1.0:1789498790.379849:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885675520 00000100:00100000:1.0:1789498790.379971:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498790.379983:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885675520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498790.380056:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498790.380164:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885675520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498790.380173:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789498790.380216:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885675520:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789498790.380310:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789498791.340065:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498791.963895:0:19895:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498791.963909:0:19895:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498791.965319:0:19895:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498791.965434:0:19895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789498792.334237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498792.334334:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498792.334370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498792.334411:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498792.334476:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864723968 00000100:00100000:1.0:1789498792.334492:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864723968 00000100:00100000:1.0:1789498792.334592:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:1.0:1789498792.334606:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864723968:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498792.334710:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864723968:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 108us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498792.334720:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00080000:1.0:1789498792.334751:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498792.339585:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864723712 00000100:00100000:3.0:1789498792.339609:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864723712 00000100:00100000:3.0:1789498792.339882:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 176 00000100:00100000:3.0:1789498792.339894:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864723712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498792.341520:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864723712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1610us (7471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498792.341539:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 176 00000100:00100000:2.0:1789498792.343303:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864723840 00000100:00100000:2.0:1789498792.343327:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864723840 00000100:00100000:2.0:1789498792.343554:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864724096 00000100:00100000:2.0:1789498792.343558:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864724096 00000100:00100000:2.0:1789498792.343594:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 159 00000100:00100000:3.0:1789498792.343602:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 160 00000100:00100000:2.0:1789498792.343606:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864723840:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498792.343610:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864724096:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:0.0:1789498792.343708:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498792.343786:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864723840:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 181us (9412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498792.343794:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 159 00000100:00100000:3.0:1789498792.343899:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864724096:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 288us (9486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498792.343916:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 160 00010000:00010000:0.0:1789498792.366277:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498793.390956:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498793.963435:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498793.963468:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885675648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498793.963572:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498793.963669:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885675648 00000100:00100000:3.0:1789498793.963679:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885675648 00000100:00100000:3.0:1789498793.963759:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789498793.963770:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885675648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498793.963834:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498793.963901:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885675648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498793.963911:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789498793.963938:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498793.963983:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885675648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498793.967179:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885675904:0@lo:400:kworker.0 00000100:00100000:1.0:1789498793.967414:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498793.967470:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498793.967477:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885676032:0@lo:400:kworker.0 00000100:00100000:1.0:1789498793.967507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498793.967552:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885675904 00000100:00100000:1.0:1789498793.967563:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885675904 00000100:00100000:1.0:1789498793.967636:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789498793.967647:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885675904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498793.967709:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885675904:12345-0@lo:400:kworker.0 Request processed in 64us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498793.967717:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789498793.967745:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885676032 00000100:00100000:1.0:1789498793.967749:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885676032 00000100:00100000:1.0:1789498793.967776:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789498793.967784:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885676032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498793.967834:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885676032:12345-0@lo:400:kworker.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498793.967863:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1789498793.967884:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498793.967926:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885676032:0@lo:400:kworker.0 00000100:00100000:1.0:1789498793.967937:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885675904:0@lo:400:kworker.0 00000100:00100000:3.0:1789498793.968132:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885675776:0@lo:400:kworker.0 00000100:00100000:3.0:1789498793.968178:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498793.968220:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885676288:0@lo:400:kworker.0 00000100:00100000:3.0:1789498793.968248:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498793.968284:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498793.968291:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885676160:0@lo:400:kworker.0 00000100:00100000:1.0:1789498793.968446:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885675776 00000100:00100000:1.0:1789498793.968452:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885675776 00000100:00100000:1.0:1789498793.968485:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789498793.968492:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885675776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498793.968530:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885675776:12345-0@lo:400:kworker.0 Request processed in 38us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498793.968536:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789498793.968614:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498793.968650:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885675776:0@lo:400:kworker.0 00000100:00100000:3.0:1789498793.968672:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885676288 00000100:00100000:3.0:1789498793.968676:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885676288 00000100:00100000:3.0:1789498793.968710:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885676160 00000100:00100000:3.0:1789498793.968713:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885676160 00000100:00100000:3.0:1789498793.968732:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789498793.968738:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885676288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498793.968781:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885676288:12345-0@lo:400:kworker.0 Request processed in 43us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498793.968787:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789498793.968799:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789498793.968805:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885676160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498793.968848:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885676160:12345-0@lo:400:kworker.0 Request processed in 42us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498793.968868:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789498793.968899:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885676160:0@lo:400:kworker.0 00000100:00100000:3.0:1789498793.968909:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885676288:0@lo:400:kworker.0 00000100:00080000:1.0:1789498793.973652:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789498794.207259:0:19947:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498794.207276:0:19947:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498794.207995:0:19947:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498794.208007:0:19947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498794.411370:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498795.438047:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498795.506833:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885676416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498795.506956:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498795.507408:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885676416 00000100:00100000:0.0:1789498795.507422:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885676416 00000100:00100000:0.0:1789498795.507513:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789498795.507527:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89eae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885676416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498795.507579:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498795.507646:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89eae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885676416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498795.507653:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789498795.510078:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498795.510113:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885676416:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789498796.357615:0:19998:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498796.357629:0:19998:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498796.358194:0:19998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498796.358206:0:19998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498796.459566:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498797.456434:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498797.456489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498797.456545:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498797.456583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498797.456620:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864724352 00000100:00100000:0.0:1789498797.456634:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864724352 00000100:00100000:1.0:1789498797.456788:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864724480 00000100:00100000:1.0:1789498797.456793:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864724480 00000100:00100000:1.0:1789498797.456838:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:1.0:1789498797.456850:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864724480:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498797.457418:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864724480:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 565us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498797.457429:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:3.0:1789498797.457560:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864724224 00000100:00100000:3.0:1789498797.457568:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864724224 00000100:00100000:3.0:1789498797.457608:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 178 00000100:00100000:3.0:1789498797.457616:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864724224:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498797.457653:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864724224:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498797.457660:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 178 00000100:00080000:3.0:1789498797.458156:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498797.458164:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498797.458270:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864724608 00000100:00100000:0.0:1789498797.458277:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864724608 00000100:00080000:3.0:1789498797.458422:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498797.465537:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:2.0:1789498797.465580:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864724352:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498797.465809:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864724352:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 252us (9262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498797.465819:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:2.0:1789498797.465865:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:2.0:1789498797.465875:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864724608:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498797.465907:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864724608:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (9324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498797.465914:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 165 00010000:00010000:1.0:1789498797.485665:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498798.468531:0:20050:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498798.468545:0:20050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498798.470954:0:20050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498798.470983:0:20050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498798.510034:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498799.083624:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885676672:0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.083750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498799.083773:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885676928:0@lo:400:kworker.0 00000100:00100000:3.0:1789498799.083812:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498799.083814:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885677184:0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.083840:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498799.083848:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498799.083854:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885676544:0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.083862:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498799.083866:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885676800:0@lo:400:kworker.0 00000100:00100000:1.0:1789498799.083959:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885676672 00000100:00100000:1.0:1789498799.083970:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885676672 00000100:00100000:2.0:1789498799.084005:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885677312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498799.085320:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498799.085757:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885676800 00000100:00100000:0.0:1789498799.085771:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885676800 00000100:00100000:1.0:1789498799.087194:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789498799.087293:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885676672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498799.087634:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498799.087761:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885676672:12345-0@lo:400:kworker.0 Request processed in 553us (4010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498799.087772:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789498799.087812:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885676928 00000100:00100000:1.0:1789498799.087822:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885676928 00000100:00100000:1.0:1789498799.088337:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885677184 00000100:00100000:1.0:1789498799.088345:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885677184 00000100:00100000:2.0:1789498799.092200:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498799.092321:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885677312 00000100:00100000:2.0:1789498799.092334:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885677312 00000100:00100000:2.0:1789498799.092400:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789498799.092414:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885677312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498799.092474:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498799.092532:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885677312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498799.092540:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789498799.093879:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789498799.093896:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885676800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.093991:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885676800:12345-0@lo:400:kworker.0 Request processed in 100us (8678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498799.093999:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789498799.094126:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885676800:0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.094143:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885676672:0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.094210:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885676544 00000100:00100000:0.0:1789498799.094218:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885676544 00000100:00100000:0.0:1789498799.094252:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789498799.094259:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885676544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.094297:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885676544:12345-0@lo:400:kworker.0 Request processed in 39us (6664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498799.094304:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789498799.094465:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789498799.094475:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885676928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.094551:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885676928:12345-0@lo:400:kworker.0 Request processed in 78us (10738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498799.094558:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789498799.095135:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885677312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498799.095217:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885676544:0@lo:400:kworker.0 00000100:00100000:2.0:1789498799.095232:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885677056:0@lo:400:kworker.0 00000100:00100000:2.0:1789498799.095284:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498799.095328:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885676928:0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.096711:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885677056 00000100:00100000:0.0:1789498799.096742:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885677056 00000100:00100000:0.0:1789498799.096808:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789498799.096820:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885677056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498799.096918:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885677056:12345-0@lo:400:kworker.0 Request processed in 99us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498799.096926:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789498799.097418:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885677056:0@lo:400:kworker.0 00000100:00080000:3.0:1789498799.098025:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498799.098034:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498799.098038:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498799.100146:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789498799.100168:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885677184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498799.100327:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885677184:12345-0@lo:400:kworker.0 Request processed in 166us (16482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498799.100336:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789498799.100477:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885677184:0@lo:400:kworker.0 00010000:00010000:1.0:1789498799.535760:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498799.597232:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498799.597248:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498799.597833:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498799.597847:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498800.555445:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498800.619559:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498800.619594:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885677440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498800.619700:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498800.619792:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885677440 00000100:00100000:0.0:1789498800.619804:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885677440 00000100:00100000:0.0:1789498800.619872:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789498800.619882:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885677440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498800.619934:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498800.619992:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885677440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498800.620000:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789498800.620053:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885677440:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789498800.707841:0:20101:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498800.707856:0:20101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498800.710804:0:20101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498800.710840:0:20101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498801.582395:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498802.577882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498802.578447:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498802.578581:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864724864 00000100:00100000:2.0:1789498802.578596:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864724864 00000100:00100000:2.0:1789498802.578681:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864725120 00000100:00100000:2.0:1789498802.578685:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864725120 00000100:00100000:2.0:1789498802.578714:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:2.0:1789498802.578725:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864724864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498802.578831:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864724864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 107us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498802.578876:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:2.0:1789498802.578898:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 170 00000100:00100000:2.0:1789498802.578904:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864725120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498802.578932:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864725120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498802.578938:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 170 00000100:00080000:3.0:1789498802.579118:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498802.579809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498802.579945:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498802.580012:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864724736 00000100:00100000:1.0:1789498802.580021:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864724736 00000100:00100000:1.0:1789498802.580071:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:1.0:1789498802.580120:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864724736:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498802.580243:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864724992 00000100:00100000:2.0:1789498802.580248:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864724992 00000100:00100000:2.0:1789498802.580307:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:2.0:1789498802.580316:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864724992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498802.585987:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864724736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5873us (6157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498802.586012:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:2.0:1789498802.586193:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864724992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5875us (6244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498802.586205:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00080000:2.0:1789498802.587170:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789498802.606615:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498802.893848:0:20153:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498802.893864:0:20153:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498802.896084:0:20153:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498802.896134:0:20153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498803.627478:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498804.208594:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885677568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498804.208680:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498804.208760:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885677568 00000100:00100000:2.0:1789498804.208768:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885677568 00000100:00100000:2.0:1789498804.208822:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789498804.208831:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885677568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498804.208870:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498804.208914:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885677568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498804.208922:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789498804.208958:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498804.208997:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885677568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498804.211042:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabafadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885677824:0@lo:400:kworker.0 00000100:00100000:1.0:1789498804.211534:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885677696:0@lo:400:kworker.0 00000100:00100000:1.0:1789498804.211578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498804.211624:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885678208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498804.211663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498804.211747:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885677696 00000100:00100000:0.0:1789498804.211755:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885677696 00000100:00100000:0.0:1789498804.211807:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789498804.211816:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885677696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498804.211882:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885677696:12345-0@lo:400:kworker.0 Request processed in 68us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498804.211890:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789498804.211929:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885677696:0@lo:400:kworker.0 00000100:00100000:3.0:1789498804.211974:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498804.212014:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885677952:0@lo:400:kworker.0 00000100:00100000:3.0:1789498804.212040:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498804.212061:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498804.212066:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885678080:0@lo:400:kworker.0 00000100:00100000:2.0:1789498804.212406:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885678208 00000100:00100000:2.0:1789498804.212413:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885678208 00000100:00100000:2.0:1789498804.212450:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885677952 00000100:00100000:2.0:1789498804.212453:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885677952 00000100:00100000:2.0:1789498804.212470:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789498804.212476:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885678208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498804.212518:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885678208:12345-0@lo:400:kworker.0 Request processed in 42us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498804.212523:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789498804.212534:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789498804.212539:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885677952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498804.212562:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885677952:12345-0@lo:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498804.212567:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1789498804.212581:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498804.212739:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885677824 00000100:00100000:0.0:1789498804.212744:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885677824 00000100:00100000:0.0:1789498804.212888:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789498804.212895:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885677824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498804.212936:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885677824:12345-0@lo:400:kworker.0 Request processed in 41us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498804.212942:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789498804.212982:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885678208:0@lo:400:kworker.0 00000100:00100000:3.0:1789498804.213042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498804.213082:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885677952:0@lo:400:kworker.0 00000100:00080000:2.0:1789498804.213288:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498804.213393:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885678080 00000100:00100000:1.0:1789498804.213398:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885678080 00000100:00100000:1.0:1789498804.213432:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789498804.213438:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885678080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498804.213474:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885678080:12345-0@lo:400:kworker.0 Request processed in 36us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498804.213480:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789498804.213556:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabafadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885677824:0@lo:400:kworker.0 00000100:00100000:3.0:1789498804.213581:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885678080:0@lo:400:kworker.0 00000100:00080000:2.0:1789498804.213620:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789498804.651369:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498804.820425:0:20204:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498804.820434:0:20204:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498804.825278:0:20204:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498804.825303:0:20204:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498805.675904:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498805.739405:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498805.744021:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885678336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498805.746181:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498805.746454:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885678336 00000100:00100000:2.0:1789498805.746465:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885678336 00000100:00100000:2.0:1789498805.746525:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789498805.746535:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885678336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498805.746575:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498805.746691:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885678336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498805.746696:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789498805.746803:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885678336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498806.699812:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498806.894433:0:20255:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498806.894445:0:20255:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498806.895277:0:20255:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498806.895287:0:20255:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498807.694086:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498807.694162:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498807.694211:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498807.694254:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498807.694284:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864725376 00000100:00100000:1.0:1789498807.694293:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864725376 00000100:00100000:1.0:1789498807.694356:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864725632 00000100:00100000:1.0:1789498807.694359:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864725632 00000100:00100000:0.0:1789498807.694538:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864725248 00000100:00100000:0.0:1789498807.694543:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864725248 00000100:00100000:2.0:1789498807.694558:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864725504 00000100:00100000:2.0:1789498807.694580:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864725504 00000100:00100000:0.0:1789498807.694608:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 182 00000100:00100000:0.0:1789498807.694620:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864725248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498807.694627:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1789498807.694637:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864725504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498807.694703:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864725248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498807.694710:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 182 00000100:00080000:0.0:1789498807.694763:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498807.694768:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498807.694853:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:1.0:1789498807.694862:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864725376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498807.695263:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864725504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 619us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498807.695270:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:1.0:1789498807.698662:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864725376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 3788us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498807.698680:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:1.0:1789498807.699518:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 175 00000100:00100000:1.0:1789498807.699535:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864725632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498807.699604:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864725632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (5348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498807.699611:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 175 00010000:00010000:0.0:1789498807.723707:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498808.752597:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498808.899311:0:20307:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498808.899321:0:20307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498808.900555:0:20307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498808.900573:0:20307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498809.323404:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885678848:0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.323494:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498809.323568:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498809.323575:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885678720:0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.323602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498809.323642:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885678848 00000100:00100000:3.0:1789498809.323649:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885678848 00000100:00100000:3.0:1789498809.323697:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789498809.323705:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885678848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.323768:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885678848:12345-0@lo:400:kworker.0 Request processed in 51us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498809.323777:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789498809.323801:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885678720 00000100:00100000:3.0:1789498809.323805:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885678720 00000100:00100000:3.0:1789498809.323851:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789498809.323865:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885678720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.323898:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885678720:12345-0@lo:400:kworker.0 Request processed in 41us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498809.323905:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1789498809.323920:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498809.323961:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885678720:0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.323971:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885678848:0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.324574:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885678592:0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.324618:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498809.324676:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885679104:0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.324702:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498809.324722:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789498809.324729:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885678464:0@lo:400:kworker.0 00000100:00100000:1.0:1789498809.325383:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885679104 00000100:00100000:1.0:1789498809.325393:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885679104 00000100:00100000:1.0:1789498809.325715:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789498809.325725:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885679104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.325848:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498809.326028:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885678464 00000100:00100000:2.0:1789498809.326034:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885678464 00000100:00100000:2.0:1789498809.326066:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789498809.326073:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885678464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.326151:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885678592 00000100:00100000:3.0:1789498809.326157:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885678592 00000100:00100000:3.0:1789498809.326200:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789498809.326208:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885678592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.333965:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885678976:0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.334048:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498809.334239:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885679232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498809.334273:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498809.334334:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885679232 00000100:00100000:0.0:1789498809.334344:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885679232 00000100:00100000:0.0:1789498809.334402:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498809.334412:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885679232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498809.334806:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498809.334989:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885679232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 577us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498809.334998:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789498809.335033:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498809.335040:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498809.335077:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885679232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498809.335146:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885678976 00000100:00100000:0.0:1789498809.335150:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885678976 00000100:00100000:0.0:1789498809.335262:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789498809.335272:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885678976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.335316:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885678976:12345-0@lo:400:kworker.0 Request processed in 47us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498809.335342:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1789498809.335359:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498809.335380:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885678976:0@lo:400:kworker.0 00000100:00100000:2.0:1789498809.335650:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885678464:12345-0@lo:400:kworker.0 Request processed in 9574us (9799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498809.335661:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789498809.335704:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885678464:0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.336733:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885678592:12345-0@lo:400:kworker.0 Request processed in 10520us (12109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498809.336745:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789498809.336984:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885678592:0@lo:400:kworker.0 00000100:00100000:1.0:1789498809.341440:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885679104:12345-0@lo:400:kworker.0 Request processed in 15687us (16706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498809.341460:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789498809.344431:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885679104:0@lo:400:kworker.0 00010000:00010000:3.0:1789498809.771360:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498809.835425:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498809.835435:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498809.835968:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498809.835977:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498810.799811:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498810.860576:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885679360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498810.861126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498810.861206:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885679360 00000100:00100000:1.0:1789498810.861230:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885679360 00000100:00100000:1.0:1789498810.862368:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789498810.862381:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885679360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498810.862425:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498810.862491:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885679360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498810.862498:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789498810.862993:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabad09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885679360:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789498811.179419:0:20358:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498811.179434:0:20358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498811.180437:0:20358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498811.180796:0:20358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498811.820295:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498812.816185:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498812.816226:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498812.816288:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498812.816327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498812.816364:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864725888 00000100:00100000:1.0:1789498812.816596:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864725888 00000100:00100000:1.0:1789498812.816690:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864726144 00000100:00100000:1.0:1789498812.816694:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864726144 00000100:00100000:1.0:1789498812.816727:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 179 00000100:00100000:1.0:1789498812.816740:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864725888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498812.816872:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864725888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 135us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498812.816882:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 179 00000100:00100000:1.0:1789498812.816906:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:1.0:1789498812.816911:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864726144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498812.816935:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864726144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498812.816941:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:1.0:1789498812.816961:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864725760 00000100:00100000:1.0:1789498812.816981:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864725760 00000100:00100000:1.0:1789498812.817009:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 184 00000100:00100000:1.0:1789498812.817016:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864725760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498812.817045:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864725760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498812.817052:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 184 00000100:00100000:1.0:1789498812.817140:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864726016 00000100:00100000:1.0:1789498812.817144:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864726016 00000100:00100000:1.0:1789498812.817178:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:1.0:1789498812.817185:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864726016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498812.817214:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864726016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498812.817221:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00080000:0.0:1789498812.820054:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498812.820068:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498812.844980:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498813.244781:0:20409:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498813.244792:0:20409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498813.247561:0:20409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498813.247584:0:20409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498813.867333:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498814.443637:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885679488:0@lo:400:kworker.0 00000100:00100000:2.0:1789498814.443712:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498814.443768:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885680000:0@lo:400:kworker.0 00000100:00100000:2.0:1789498814.443795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498814.443821:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789498814.443826:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885679616:0@lo:400:kworker.0 00000100:00100000:2.0:1789498814.443852:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498814.443868:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885680128:0@lo:400:kworker.0 00000100:00100000:2.0:1789498814.443890:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498814.444119:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885679744:0@lo:400:kworker.0 00000100:00100000:3.0:1789498814.444148:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498814.444262:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498814.444269:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885679872:0@lo:400:kworker.0 00000100:00100000:3.0:1789498814.444294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498814.444329:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885679616 00000100:00100000:3.0:1789498814.444339:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885679616 00000100:00100000:3.0:1789498814.444613:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885679744 00000100:00100000:3.0:1789498814.444617:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885679744 00000100:00100000:3.0:1789498814.444639:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789498814.444647:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885679616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498814.444716:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885679616:12345-0@lo:400:kworker.0 Request processed in 70us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.444724:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789498814.444741:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789498814.444747:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885679744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498814.444780:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885679744:12345-0@lo:400:kworker.0 Request processed in 33us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.444785:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789498814.444804:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885680000 00000100:00100000:3.0:1789498814.444807:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885680000 00000100:00100000:3.0:1789498814.444852:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885680128 00000100:00100000:3.0:1789498814.444856:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885680128 00000100:00100000:3.0:1789498814.444869:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885679872 00000100:00100000:3.0:1789498814.446076:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885679872 00000100:00100000:3.0:1789498814.446136:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789498814.446145:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885680000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.446478:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885679488 00000100:00100000:1.0:1789498814.446486:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885679488 00000100:00100000:1.0:1789498814.446524:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789498814.446531:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885679488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.446608:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885679488:12345-0@lo:400:kworker.0 Request processed in 77us (2895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498814.446615:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789498814.446656:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789498814.446663:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885680128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.446710:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885680128:12345-0@lo:400:kworker.0 Request processed in 47us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498814.446717:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789498814.446734:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789498814.446740:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885679872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.446769:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885679872:12345-0@lo:400:kworker.0 Request processed in 30us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498814.446774:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789498814.446982:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885679872:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.446999:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885679744:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.447041:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885679616:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.447051:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885680128:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.447060:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885679488:0@lo:400:kworker.0 00000100:00100000:3.0:1789498814.447511:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885680000:12345-0@lo:400:kworker.0 Request processed in 1366us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.447520:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1789498814.448217:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498814.448225:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498814.448228:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498814.448630:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885680000:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.451374:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885680256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498814.451475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498814.451552:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885680256 00000100:00100000:1.0:1789498814.451562:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885680256 00000100:00100000:1.0:1789498814.451613:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789498814.451623:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885680256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498814.451662:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498814.451707:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885680256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498814.451729:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789498814.451782:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885680256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789498814.892916:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498815.247033:0:20460:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498815.247042:0:20460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498815.253760:0:20460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498815.253780:0:20460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498815.917676:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498815.979787:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885680384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498815.979878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498815.980473:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885680384 00000100:00100000:1.0:1789498815.980483:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885680384 00000100:00100000:1.0:1789498815.980548:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789498815.980557:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885680384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498815.980602:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498815.980677:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885680384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498815.980685:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789498815.982305:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885680384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789498816.941368:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498817.207275:0:20513:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498817.207283:0:20513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498817.208041:0:20513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498817.208054:0:20513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498817.935165:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498817.935219:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498817.935371:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864726272 00000100:00100000:0.0:1789498817.935391:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864726272 00000100:00100000:0.0:1789498817.935454:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 186 00000100:00100000:0.0:1789498817.935465:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864726272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498817.935542:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864726272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498817.935549:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 186 00000100:00100000:2.0:1789498817.936482:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498817.936522:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498817.936595:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864726528 00000100:00100000:0.0:1789498817.936601:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864726528 00000100:00100000:0.0:1789498817.936654:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:0.0:1789498817.936663:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864726528:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498817.936722:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864726528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 61us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498817.936730:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00080000:2.0:1789498817.936792:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498817.936844:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864726400 00000100:00100000:3.0:1789498817.936850:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864726400 00000100:00100000:1.0:1789498817.936991:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864726656 00000100:00100000:1.0:1789498817.936997:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864726656 00000100:00100000:3.0:1789498817.937718:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 184 00000100:00100000:3.0:1789498817.937728:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864726400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498817.937775:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864726400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498817.937781:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 184 00000100:00080000:2.0:1789498817.939113:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498817.947652:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 185 00000100:00100000:0.0:1789498817.947675:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864726656:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498817.947784:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864726656:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 118us (11304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498817.947792:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 185 00010000:00010000:1.0:1789498817.963963:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498818.993281:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498819.052351:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498819.052378:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498819.053174:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498819.053189:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1789498819.169835:0:20564:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498819.169865:0:20564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498819.170493:0:20564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498819.170505:0:20564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789498819.565528:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498819.565565:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885680512:0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.565678:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498819.565744:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498819.565755:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885680640:0@lo:400:kworker.0 00000100:00100000:1.0:1789498819.565795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498819.565821:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885680768:0@lo:400:kworker.0 00000100:00100000:1.0:1789498819.565836:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885680640 00000100:00100000:1.0:1789498819.565845:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885680640 00000100:00100000:0.0:1789498819.565849:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498819.565886:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885680768 00000100:00100000:0.0:1789498819.565889:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885680768 00000100:00100000:2.0:1789498819.565963:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885680512 00000100:00100000:2.0:1789498819.565969:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885680512 00000100:00100000:2.0:1789498819.566011:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789498819.566023:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885680512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498819.566117:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885680512:12345-0@lo:400:kworker.0 Request processed in 95us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498819.566127:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789498819.566283:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789498819.566292:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885680768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.566336:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885680768:12345-0@lo:400:kworker.0 Request processed in 46us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498819.566342:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789498819.567207:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885680512:0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.567269:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498819.567279:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885681024:0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.567343:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498819.567396:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885681024 00000100:00100000:3.0:1789498819.567404:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885681024 00000100:00100000:3.0:1789498819.567452:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789498819.567463:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885681024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.567516:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885681024:12345-0@lo:400:kworker.0 Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498819.567523:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789498819.567554:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885681024:0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.567610:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885681152:0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.567636:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498819.567679:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885681152 00000100:00100000:3.0:1789498819.567683:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885681152 00000100:00100000:3.0:1789498819.567710:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789498819.567716:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885681152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.567753:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885681152:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498819.567759:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789498819.567786:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885681280:0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.567812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498819.567839:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885680768:0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.567852:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498819.567875:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885680896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498819.567906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498819.567936:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885681280 00000100:00100000:3.0:1789498819.567940:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885681280 00000100:00100000:3.0:1789498819.567965:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789498819.567971:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885681280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.568005:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885681280:12345-0@lo:400:kworker.0 Request processed in 34us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498819.568012:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789498819.568037:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885681280:0@lo:400:kworker.0 00000100:00100000:3.0:1789498819.568056:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885681152:0@lo:400:kworker.0 00000100:00080000:3.0:1789498819.568083:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498819.568116:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498819.568120:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498819.568150:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885680896 00000100:00100000:3.0:1789498819.568154:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885680896 00000100:00100000:3.0:1789498819.568184:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789498819.568192:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885680896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498819.568233:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498819.568273:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885680896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498819.568280:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789498819.568311:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885680896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498819.571023:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789498819.571055:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885680640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498819.571227:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885680640:12345-0@lo:400:kworker.0 Request processed in 189us (5429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498819.571236:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789498819.571305:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885680640:0@lo:400:kworker.0 00010000:00010000:0.0:1789498820.012589:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498821.043021:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498821.101716:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885681408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498821.101961:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498821.102124:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885681408 00000100:00100000:1.0:1789498821.102136:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885681408 00000100:00100000:1.0:1789498821.102227:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789498821.102240:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885681408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498821.102307:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498821.102395:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885681408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498821.102404:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789498821.102468:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885681408:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789498821.102577:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789498821.291918:0:20615:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498821.291933:0:20615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498821.292511:0:20615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498821.292520:0:20615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498822.060926:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498823.055802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498823.055851:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498823.055894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498823.055930:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498823.056038:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864726784 00000100:00100000:0.0:1789498823.056063:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864726784 00000100:00100000:0.0:1789498823.056158:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 188 00000100:00100000:0.0:1789498823.056171:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864726784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498823.056267:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864726784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 99us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498823.056276:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 188 00000100:00100000:3.0:1789498823.056641:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864726912 00000100:00100000:3.0:1789498823.056655:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864726912 00000100:00080000:0.0:1789498823.057748:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498823.057891:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864727168 00000100:00100000:3.0:1789498823.057902:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864727168 00000100:00080000:1.0:1789498823.057974:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498823.059491:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864727040 00000100:00100000:2.0:1789498823.059508:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864727040 00000100:00100000:2.0:1789498823.059651:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:2.0:1789498823.059667:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864727040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498823.059793:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864727040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 131us (3939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498823.059803:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00080000:1.0:1789498823.060961:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498823.061278:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 189 00000100:00100000:0.0:1789498823.061308:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864726912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498823.061388:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864726912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 98us (5493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498823.061396:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 189 00000100:00100000:0.0:1789498823.061423:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00100000:0.0:1789498823.061430:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864727168:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498823.061458:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864727168:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (5528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498823.061465:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 190 00010000:00010000:1.0:1789498823.092433:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498823.381016:0:20667:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498823.381031:0:20667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498823.381796:0:20667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498823.381809:0:20667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498824.108247:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498824.684375:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885681536:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.684482:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498824.684548:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885682048:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.684588:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498824.684622:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498824.684629:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885681664:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.684659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498824.684679:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885682176:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.684708:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498824.684742:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885681792:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.684768:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498824.684789:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498824.684795:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885681920:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.684817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498824.684854:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885681536 00000100:00100000:3.0:1789498824.684863:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885681536 00000100:00100000:3.0:1789498824.684923:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789498824.684934:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885681536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.684996:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885681536:12345-0@lo:400:kworker.0 Request processed in 64us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498824.685004:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789498824.685041:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885682048 00000100:00100000:3.0:1789498824.685045:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885682048 00000100:00100000:3.0:1789498824.685085:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885682176 00000100:00100000:3.0:1789498824.685130:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885682176 00000100:00100000:3.0:1789498824.685149:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885681920 00000100:00100000:3.0:1789498824.685151:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885681920 00000100:00100000:3.0:1789498824.685164:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789498824.685169:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885682048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685204:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885682048:12345-0@lo:400:kworker.0 Request processed in 34us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498824.685210:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789498824.685222:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789498824.685228:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885682176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685255:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885682176:12345-0@lo:400:kworker.0 Request processed in 27us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498824.685275:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789498824.685288:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789498824.685295:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885681920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685327:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885681920:12345-0@lo:400:kworker.0 Request processed in 33us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498824.685334:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789498824.685352:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885681664 00000100:00100000:3.0:1789498824.685356:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885681664 00000100:00100000:3.0:1789498824.685383:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885681792 00000100:00100000:3.0:1789498824.685385:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885681792 00000100:00100000:3.0:1789498824.685408:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789498824.685415:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885681664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685447:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885681664:12345-0@lo:400:kworker.0 Request processed in 33us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498824.685454:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789498824.685473:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789498824.685479:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885681792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685510:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885681792:12345-0@lo:400:kworker.0 Request processed in 31us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498824.685516:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789498824.685550:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498824.685556:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498824.685559:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498824.685620:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885681920:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685632:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885681792:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685671:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885681664:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685681:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885682176:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685690:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885681536:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.685700:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea874bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885682048:0@lo:400:kworker.0 00000100:00100000:3.0:1789498824.691453:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498824.691499:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885682304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498824.691625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498824.691805:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885682304 00000100:00100000:2.0:1789498824.691818:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885682304 00000100:00100000:2.0:1789498824.691884:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789498824.691896:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea874bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885682304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498824.691960:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498824.692023:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea874bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885682304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498824.692031:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789498824.692916:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885682304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789498825.142206:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498825.615280:0:20718:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498825.615297:0:20718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498825.615837:0:20718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498825.615851:0:20718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498826.155475:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498826.220024:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498826.220060:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885682432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498826.220192:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498826.220357:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885682432 00000100:00100000:2.0:1789498826.220372:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885682432 00000100:00100000:2.0:1789498826.220526:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789498826.220539:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885682432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498826.220590:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498826.220665:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885682432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498826.220695:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789498826.220709:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885682432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789498826.225609:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789498827.185547:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498827.604540:0:20769:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498827.604556:0:20769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498827.604959:0:20769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498827.604969:0:20769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498828.176249:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498828.176400:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864727296 00000100:00100000:1.0:1789498828.176418:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864727296 00000100:00100000:1.0:1789498828.176498:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00100000:1.0:1789498828.176510:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864727296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498828.176627:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864727296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 117us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498828.176636:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00100000:2.0:1789498828.177018:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498828.177139:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864727424 00000100:00100000:3.0:1789498828.177145:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864727424 00000100:00100000:3.0:1789498828.177221:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 194 00000100:00100000:3.0:1789498828.177230:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864727424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498828.177282:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864727424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 54us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.177290:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 194 00000100:00080000:2.0:1789498828.178000:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498828.190773:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498828.191030:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864727552 00000100:00100000:3.0:1789498828.191046:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864727552 00000100:00100000:3.0:1789498828.191211:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:3.0:1789498828.191226:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864727552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498828.191336:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864727552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 112us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.191345:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00080000:2.0:1789498828.191486:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498828.191540:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498828.191885:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864727680 00000100:00100000:3.0:1789498828.191892:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864727680 00000100:00100000:3.0:1789498828.191951:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 195 00000100:00100000:3.0:1789498828.191959:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864727680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498828.192004:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864727680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 46us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.192012:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 195 00000100:00080000:2.0:1789498828.192563:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789498828.204921:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498829.240379:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498829.291468:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498829.291482:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498829.292818:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498829.292840:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498829.812403:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885682560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498829.812505:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498829.812630:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885682560 00000100:00100000:1.0:1789498829.812643:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885682560 00000100:00100000:1.0:1789498829.812727:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789498829.812737:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885682560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498829.812797:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498829.812860:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885682560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498829.812868:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789498829.812916:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498829.812969:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885682560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498829.815421:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885682816:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.815531:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498829.815593:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498829.815599:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885682944:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.815628:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498829.815670:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885682816 00000100:00100000:3.0:1789498829.815681:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885682816 00000100:00100000:3.0:1789498829.815758:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789498829.815769:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885682816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.815841:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885682816:12345-0@lo:400:kworker.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498829.815850:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789498829.815880:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885682944 00000100:00100000:3.0:1789498829.815885:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885682944 00000100:00100000:3.0:1789498829.815915:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789498829.815922:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885682944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.815957:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885682944:12345-0@lo:400:kworker.0 Request processed in 36us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498829.815963:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789498829.815988:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885682688:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816025:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498829.816052:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885683200:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816078:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498829.816131:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498829.816137:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885683072:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816165:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498829.816213:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885682688 00000100:00100000:3.0:1789498829.816229:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885682688 00000100:00100000:3.0:1789498829.816265:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789498829.816275:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885682688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816315:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885682688:12345-0@lo:400:kworker.0 Request processed in 43us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498829.816323:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789498829.816357:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885683200 00000100:00100000:3.0:1789498829.816361:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885683200 00000100:00100000:3.0:1789498829.816388:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885683072 00000100:00100000:3.0:1789498829.816392:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885683072 00000100:00100000:3.0:1789498829.816409:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789498829.816415:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885683200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816450:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885683200:12345-0@lo:400:kworker.0 Request processed in 33us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498829.816457:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789498829.816468:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789498829.816474:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885683072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816502:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885683072:12345-0@lo:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498829.816509:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1789498829.816531:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498829.816538:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498829.816579:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885683072:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816592:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabafac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885682688:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816603:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885683200:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816642:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885682944:0@lo:400:kworker.0 00000100:00100000:3.0:1789498829.816665:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885682816:0@lo:400:kworker.0 00000040:00080000:1.0:1789498829.882068:0:20821:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498829.882082:0:20821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498829.883730:0:20821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498829.883779:0:20821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498830.254220:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498831.275214:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498831.339463:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885683328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498831.339546:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498831.339719:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885683328 00000100:00100000:2.0:1789498831.339728:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885683328 00000100:00100000:2.0:1789498831.339791:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789498831.339800:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885683328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498831.339838:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789498831.340339:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498831.340479:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885683328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 678us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498831.340489:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789498831.340559:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885683328:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498831.883659:0:20872:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498831.883669:0:20872:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498831.884212:0:20872:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498831.884222:0:20872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498832.299412:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498833.298892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498833.298934:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498833.298965:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498833.298995:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498833.299026:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864727936 00000100:00100000:1.0:1789498833.299035:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864727936 00000100:00100000:1.0:1789498833.299134:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864728192 00000100:00100000:1.0:1789498833.299138:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864728192 00000100:00100000:1.0:1789498833.299165:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 199 00000100:00100000:1.0:1789498833.299175:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864727936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498833.299253:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864727936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498833.299261:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 199 00000100:00100000:1.0:1789498833.299278:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 200 00000100:00100000:1.0:1789498833.299284:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864728192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498833.299307:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864728192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498833.299313:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 200 00000100:00100000:1.0:1789498833.299331:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864727808 00000100:00100000:1.0:1789498833.299334:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864727808 00000100:00100000:1.0:1789498833.299358:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 192 00000100:00100000:1.0:1789498833.299578:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864727808:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498833.299809:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864727808:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 444us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498833.299818:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 192 00000100:00100000:1.0:1789498833.299884:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864728064 00000100:00100000:1.0:1789498833.299893:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864728064 00000100:00100000:1.0:1789498833.300802:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:1.0:1789498833.300816:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864728064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498833.300867:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864728064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 56us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498833.300875:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00080000:0.0:1789498833.305316:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498833.305328:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789498833.323503:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498833.949989:0:20923:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498833.950000:0:20923:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498833.956056:0:20923:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498833.956341:0:20923:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789498834.347404:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498834.923558:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885683456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498834.923659:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.923925:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885683712:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.923969:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.923991:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789498834.923997:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885683584:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.924024:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498834.924201:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885683840:0@lo:400:kworker.0 00000100:00100000:0.0:1789498834.924236:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498834.924306:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885683456 00000100:00100000:1.0:1789498834.924316:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885683456 00000100:00100000:1.0:1789498834.924374:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789498834.924384:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885683456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498834.924423:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498834.924466:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885683456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498834.924473:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789498834.924503:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885683840 00000100:00100000:1.0:1789498834.924507:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885683840 00000100:00100000:1.0:1789498834.924537:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789498834.924544:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885683840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498834.924576:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885683840:12345-0@lo:400:kworker.0 Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498834.924583:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1789498834.925017:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498834.927704:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885683584 00000100:00100000:0.0:1789498834.927722:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885683584 00000100:00100000:0.0:1789498834.928295:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789498834.928309:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea89151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885683584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498834.928397:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea89151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885683584:12345-0@lo:400:kworker.0 Request processed in 92us (4371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498834.928405:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789498834.930972:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885683584:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.930991:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885684096:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.931061:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.931190:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885684096 00000100:00100000:3.0:1789498834.931197:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885684096 00000100:00100000:3.0:1789498834.931290:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789498834.931299:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885684096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.931353:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885684096:12345-0@lo:400:kworker.0 Request processed in 54us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.931360:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:3.0:1789498834.931381:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498834.931403:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885684096:0@lo:400:kworker.0 00000100:00100000:2.0:1789498834.937785:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885683840:0@lo:400:kworker.0 00000100:00100000:2.0:1789498834.937822:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498834.937836:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885683968:0@lo:400:kworker.0 00000100:00100000:2.0:1789498834.937911:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.938254:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885683968 00000100:00100000:3.0:1789498834.938263:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885683968 00000100:00100000:3.0:1789498834.938340:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789498834.938349:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885683968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.938405:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885683968:12345-0@lo:400:kworker.0 Request processed in 56us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.938412:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1789498834.938542:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498834.938568:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885683968:0@lo:400:kworker.0 00000100:00100000:1.0:1789498834.941880:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885683712 00000100:00100000:1.0:1789498834.941897:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885683712 00000100:00100000:1.0:1789498834.941984:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789498834.941995:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885683712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498834.942140:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabafac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885683712:12345-0@lo:400:kworker.0 Request processed in 147us (18169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498834.942147:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1789498834.942251:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498834.942412:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885683712:0@lo:400:kworker.0 00000100:00100000:0.0:1789498834.945282:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885683456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789498835.380210:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498836.177621:0:20974:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498836.177634:0:20974:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498836.178229:0:20974:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498836.178240:0:20974:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789498836.398738:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498836.459573:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498836.459608:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885684224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498836.459720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498836.460015:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885684224 00000100:00100000:3.0:1789498836.460028:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885684224 00000100:00100000:3.0:1789498836.460157:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789498836.460171:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885684224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498836.460368:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498836.460441:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885684224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 274us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498836.460450:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789498836.460524:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885684224:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789498836.460895:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789498837.420653:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498838.344202:0:21026:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498838.344218:0:21026:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498838.344734:0:21026:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498838.344745:0:21026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498838.413471:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498838.413529:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498838.413560:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498838.413593:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498838.413642:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864728576 00000100:00100000:2.0:1789498838.413656:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864728576 00000100:00100000:2.0:1789498838.413748:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:2.0:1789498838.413762:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864728576:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498838.413825:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864728448 00000100:00100000:3.0:1789498838.413844:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864728448 00000100:00100000:2.0:1789498838.413860:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864728576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498838.413868:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:3.0:1789498838.413881:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864728704 00000100:00100000:3.0:1789498838.413883:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864728704 00000100:00100000:3.0:1789498838.413907:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:3.0:1789498838.413914:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864728448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498838.413954:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864728448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498838.413960:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:3.0:1789498838.413974:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 205 00000100:00100000:3.0:1789498838.413980:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864728704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498838.413982:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864728320 00000100:00100000:1.0:1789498838.413986:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864728320 00000100:00100000:3.0:1789498838.414003:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864728704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498838.414008:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 205 00000100:00100000:1.0:1789498838.414060:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 194 00000100:00100000:1.0:1789498838.414068:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864728320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498838.414133:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864728320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 66us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498838.414140:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 194 00000100:00080000:2.0:1789498838.423857:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498838.423873:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789498838.445345:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498839.467857:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498839.531433:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498839.531448:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498839.534923:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498839.534971:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498840.045944:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885684608:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.046030:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.046081:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885685120:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.046128:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.046160:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498840.046167:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885684736:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.046188:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.046227:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885684608 00000100:00100000:3.0:1789498840.046235:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885684608 00000100:00100000:3.0:1789498840.046310:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885684736 00000100:00100000:3.0:1789498840.046314:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885684736 00000100:00100000:3.0:1789498840.046341:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789498840.046352:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885684608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.046406:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885684608:12345-0@lo:400:kworker.0 Request processed in 56us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498840.046413:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789498840.046433:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789498840.046439:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885684736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.046470:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885684736:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498840.046476:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789498840.046494:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885685120 00000100:00100000:3.0:1789498840.046498:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885685120 00000100:00100000:3.0:1789498840.046528:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789498840.046534:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885685120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.046567:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885685120:12345-0@lo:400:kworker.0 Request processed in 34us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498840.046587:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1789498840.046608:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498840.046614:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498840.046617:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498840.046936:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885684736:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.046948:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885684608:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.046958:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885685120:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.047383:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885684352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498840.047423:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498840.047449:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885684864:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.047475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498840.047498:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789498840.047505:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885684480:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.047534:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498840.047561:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885684992:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.047611:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498840.047826:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885684864 00000100:00100000:0.0:1789498840.047833:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885684864 00000100:00100000:0.0:1789498840.047880:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885684992 00000100:00100000:0.0:1789498840.047883:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885684992 00000100:00100000:0.0:1789498840.047908:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789498840.047915:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885684864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.047961:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885684864:12345-0@lo:400:kworker.0 Request processed in 46us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498840.047968:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789498840.047983:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789498840.048001:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885684992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.048029:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885684992:12345-0@lo:400:kworker.0 Request processed in 41us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498840.048035:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789498840.048057:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885684480 00000100:00100000:0.0:1789498840.048061:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885684480 00000100:00100000:0.0:1789498840.048085:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789498840.048112:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885684480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.048142:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885684480:12345-0@lo:400:kworker.0 Request processed in 32us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498840.048148:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789498840.048191:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885684480:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.048201:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885684992:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.048211:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885684864:0@lo:400:kworker.0 00000100:00080000:3.0:1789498840.048438:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498840.049214:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885684352 00000100:00100000:2.0:1789498840.049231:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885684352 00000100:00100000:2.0:1789498840.049288:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789498840.049297:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885684352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498840.049338:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498840.049402:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885684352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498840.049409:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789498840.050582:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885684352:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789498840.355294:0:21077:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498840.355306:0:21077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498840.358877:0:21077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498840.358897:0:21077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789498840.492025:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498841.515516:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498841.580458:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498841.580496:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9ffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885685248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498841.580601:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498841.580712:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885685248 00000100:00100000:0.0:1789498841.580724:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885685248 00000100:00100000:0.0:1789498841.580788:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789498841.580800:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885685248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498841.580859:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498841.580925:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885685248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498841.580934:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789498841.581019:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9ffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885685248:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789498842.326165:0:21128:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498842.326179:0:21128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498842.326690:0:21128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498842.326700:0:21128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789498842.541774:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498843.545064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498843.545121:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498843.545301:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864728960 00000100:00100000:3.0:1789498843.545318:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864728960 00000100:00100000:3.0:1789498843.545410:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864729216 00000100:00100000:3.0:1789498843.545426:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864729216 00000100:00100000:3.0:1789498843.545457:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 209 00000100:00100000:3.0:1789498843.545468:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864728960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498843.545597:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 210 00000100:00100000:0.0:1789498843.545609:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864729216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498843.551992:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864728960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 6501us (6922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498843.552013:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 209 00000100:00080000:3.0:1789498843.552075:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498843.557682:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864729216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 12053us (12536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498843.557705:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 210 00010000:00010000:3.0:1789498843.569152:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498843.571883:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498843.572014:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498843.572144:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864729088 00000100:00100000:3.0:1789498843.572159:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864729088 00000100:00100000:3.0:1789498843.572266:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:3.0:1789498843.572279:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864729088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498843.572396:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864729088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 120us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498843.572412:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00080000:1.0:1789498843.574820:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498843.575256:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864728832 00000100:00100000:2.0:1789498843.575296:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864728832 00000100:00100000:2.0:1789498843.575378:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 196 00000100:00100000:2.0:1789498843.575390:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864728832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498843.575523:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864728832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 135us (3657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498843.575532:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 196 00000040:00080000:3.0:1789498844.275883:0:21180:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498844.275900:0:21180:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498844.276494:0:21180:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498844.276507:0:21180:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789498844.588348:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498845.163710:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885685632:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.163728:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885685888:0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.165009:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e985ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885685376:0@lo:400:kworker.0 00000100:00100000:1.0:1789498845.165558:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885685760:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.172501:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.172651:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885685888 00000100:00100000:2.0:1789498845.172665:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885685888 00000100:00100000:2.0:1789498845.172737:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789498845.172750:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885685888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.172834:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885685888:12345-0@lo:400:kworker.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.172842:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789498845.172920:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885685888:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.173267:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.173336:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885686144:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.173375:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.173405:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885686144 00000100:00100000:3.0:1789498845.173411:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885686144 00000100:00100000:3.0:1789498845.173477:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789498845.173486:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885686144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.173540:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498845.173596:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885685504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498845.173630:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498845.173652:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885686016:0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.173679:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498845.173716:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885686016 00000100:00100000:0.0:1789498845.173720:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885686016 00000100:00100000:0.0:1789498845.173749:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789498845.173756:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885686016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.173794:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885686016:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.173801:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789498845.173822:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885685376 00000100:00100000:0.0:1789498845.173827:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885685376 00000100:00100000:0.0:1789498845.173854:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789498845.173861:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885685376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.173893:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885685376:12345-0@lo:400:kworker.0 Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.173913:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789498845.173946:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885685504 00000100:00100000:0.0:1789498845.173949:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885685504 00000100:00100000:0.0:1789498845.173979:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789498845.173986:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885685504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498845.174194:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498845.174237:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885685504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 251us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.174244:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789498845.174315:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e985ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885685376:0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.174342:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885685504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498845.174356:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885686016:0@lo:400:kworker.0 00000100:00080000:0.0:1789498845.174420:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789498845.174427:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498845.175236:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885685632 00000100:00100000:2.0:1789498845.175249:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885685632 00000100:00100000:2.0:1789498845.175327:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789498845.175339:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885685632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.175432:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885685632:12345-0@lo:400:kworker.0 Request processed in 96us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.175441:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789498845.175515:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885685632:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.177990:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885686144:12345-0@lo:400:kworker.0 Request processed in 4490us (4598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.178013:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789498845.178970:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.179860:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885685760 00000100:00100000:3.0:1789498845.179874:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885685760 00000100:00100000:3.0:1789498845.179970:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789498845.179983:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885685760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.180116:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885685760:12345-0@lo:400:kworker.0 Request processed in 108us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.180124:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789498845.180154:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885686144:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.180156:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885685760:0@lo:400:kworker.0 00000100:00080000:0.0:1789498845.180313:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789498845.612117:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498846.571425:0:21231:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498846.571443:0:21231:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498846.588082:0:21231:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498846.588170:0:21231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498846.643365:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498846.702363:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498846.702404:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885686272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498846.702512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498846.704960:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885686272 00000100:00100000:0.0:1789498846.704985:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885686272 00000100:00100000:0.0:1789498846.705069:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789498846.705082:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885686272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498846.705183:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498846.705315:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885686272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 236us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498846.705324:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789498846.705551:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885686272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498847.660602:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498848.608256:0:21282:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498848.608275:0:21282:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498848.613593:0:21282:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498848.613624:0:21282:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498848.655648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498848.655706:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498848.655761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498848.655794:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498848.655831:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864729472 00000100:00100000:1.0:1789498848.655856:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864729472 00000100:00100000:1.0:1789498848.655927:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864729728 00000100:00100000:1.0:1789498848.655930:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864729728 00000100:00100000:1.0:1789498848.655953:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:1.0:1789498848.655964:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864729472:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498848.656060:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864729472:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498848.656068:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:1.0:1789498848.656129:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00100000:1.0:1789498848.656137:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864729728:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498848.656161:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864729728:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498848.656167:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00080000:1.0:1789498848.656188:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498848.657558:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864729344 00000100:00100000:3.0:1789498848.657574:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864729344 00000100:00100000:3.0:1789498848.657639:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 198 00000100:00100000:3.0:1789498848.657649:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864729344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498848.657728:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864729344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498848.657748:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 198 00000100:00100000:3.0:1789498848.658309:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864729600 00000100:00100000:3.0:1789498848.658315:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864729600 00000100:00100000:3.0:1789498848.658499:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 112 00000100:00100000:3.0:1789498848.658508:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864729600:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498848.658554:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864729600:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 48us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498848.658561:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 112 00000100:00080000:3.0:1789498848.659006:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789498848.684563:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498849.707609:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498849.771867:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498849.771879:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498849.772585:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498849.772610:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498850.300137:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e984771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885686400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498850.300217:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498850.300302:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885686400 00000100:00100000:3.0:1789498850.300311:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885686400 00000100:00100000:3.0:1789498850.300375:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789498850.300384:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885686400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498850.300425:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498850.300472:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885686400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498850.300479:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789498850.300500:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498850.300540:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e984771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885686400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498850.301178:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498850.301192:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885686528:0@lo:400:kworker.0 00000100:00100000:2.0:1789498850.301239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498850.301293:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885686656:0@lo:400:kworker.0 00000100:00100000:2.0:1789498850.301323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498850.301379:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498850.301384:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885687040:0@lo:400:kworker.0 00000100:00100000:2.0:1789498850.301408:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498850.301438:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885687040 00000100:00100000:2.0:1789498850.301443:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885687040 00000100:00100000:2.0:1789498850.301483:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789498850.301491:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885687040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498850.301532:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885687040:12345-0@lo:400:kworker.0 Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498850.301539:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789498850.301572:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885687040:0@lo:400:kworker.0 00000100:00100000:3.0:1789498850.301886:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885686656 00000100:00100000:3.0:1789498850.301891:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885686656 00000100:00100000:3.0:1789498850.301932:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789498850.301941:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885686656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498850.301998:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885686656:12345-0@lo:400:kworker.0 Request processed in 59us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498850.302004:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789498850.302023:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885686784:0@lo:400:kworker.0 00000100:00100000:3.0:1789498850.302048:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498850.302067:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498850.302073:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885686912:0@lo:400:kworker.0 00000100:00100000:3.0:1789498850.302116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789498850.302140:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498850.302145:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498850.302161:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885686656:0@lo:400:kworker.0 00000100:00100000:3.0:1789498850.302178:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885686784 00000100:00100000:3.0:1789498850.302181:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885686784 00000100:00100000:3.0:1789498850.302202:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885686912 00000100:00100000:3.0:1789498850.302205:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885686912 00000100:00100000:3.0:1789498850.302225:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789498850.302231:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885686784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498850.302264:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885686784:12345-0@lo:400:kworker.0 Request processed in 33us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498850.302271:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789498850.302282:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789498850.302287:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885686912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498850.302314:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885686912:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498850.302320:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:3.0:1789498850.302342:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498850.302369:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885686912:0@lo:400:kworker.0 00000100:00100000:3.0:1789498850.302378:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885686784:0@lo:400:kworker.0 00000100:00100000:2.0:1789498850.304280:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885686528 00000100:00100000:2.0:1789498850.304294:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885686528 00000100:00100000:2.0:1789498850.304345:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789498850.304354:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885686528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498850.304429:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885686528:12345-0@lo:400:kworker.0 Request processed in 77us (3190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498850.304436:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789498850.305004:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885686528:0@lo:400:kworker.0 00010000:00010000:1.0:1789498850.731384:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498850.766669:0:21333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498850.766687:0:21333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498850.770637:0:21333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498850.770656:0:21333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789498851.755279:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498851.820684:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498851.820711:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885687168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498851.820816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498851.821522:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885687168 00000100:00100000:0.0:1789498851.821534:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885687168 00000100:00100000:0.0:1789498851.821594:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789498851.821603:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885687168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498851.821642:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498851.821704:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885687168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498851.821794:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789498851.823933:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885687168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498852.779725:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498852.965721:0:21385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498852.965732:0:21385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498852.966195:0:21385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498852.966204:0:21385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498853.781543:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498853.781665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498853.781693:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498853.781761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498853.781920:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864729984 00000100:00100000:3.0:1789498853.781933:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864729984 00000100:00100000:0.0:1789498853.781936:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864729856 00000100:00100000:0.0:1789498853.781940:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864729856 00000100:00100000:2.0:1789498853.781942:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864730112 00000100:00100000:2.0:1789498853.781950:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864730112 00000100:00100000:0.0:1789498853.781996:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 200 00000100:00100000:0.0:1789498853.782007:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864729856:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498853.782042:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864730240 00000100:00100000:3.0:1789498853.782045:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864730240 00000100:00100000:2.0:1789498853.782084:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:3.0:1789498853.782085:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00100000:0.0:1789498853.782086:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864729856:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498853.782115:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 200 00000100:00100000:3.0:1789498853.782116:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864729984:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498853.782126:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864730112:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498853.782153:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864729984:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498853.782161:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00100000:2.0:1789498853.782173:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864730112:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 50us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498853.782178:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00100000:2.0:1789498853.782187:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:3.0:1789498853.782194:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864730240:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498853.782232:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864730240:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498853.782239:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00080000:1.0:1789498853.793163:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498853.793177:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789498853.804052:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498854.827203:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498854.957024:0:21436:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498854.957037:0:21436:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498854.958366:0:21436:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498854.958385:0:21436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498855.403473:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885687296:0@lo:400:kworker.0 00000100:00100000:2.0:1789498855.403587:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498855.403888:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498855.403902:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885687552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498855.403936:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498855.403983:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885687552 00000100:00100000:0.0:1789498855.403993:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885687552 00000100:00100000:0.0:1789498855.404051:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789498855.404060:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498855.404061:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885687552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498855.404071:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885687424:0@lo:400:kworker.0 00002000:00000024:0.0:1789498855.404124:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498855.404126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498855.404183:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885687552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498855.404192:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789498855.404249:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885687296 00000100:00100000:2.0:1789498855.404254:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885687296 00000100:00100000:2.0:1789498855.404352:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789498855.404362:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885687296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498855.404420:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885687424 00000100:00100000:3.0:1789498855.404425:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885687424 00000100:00100000:3.0:1789498855.404459:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789498855.404467:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885687424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498855.404506:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885687424:12345-0@lo:400:kworker.0 Request processed in 40us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498855.404522:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789498855.404566:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885687424:0@lo:400:kworker.0 00000100:00100000:3.0:1789498855.404576:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885687296:0@lo:400:kworker.0 00000100:00100000:2.0:1789498855.404740:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885687296:12345-0@lo:400:kworker.0 Request processed in 380us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.404747:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1789498855.405605:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498855.405611:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498855.406840:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885687552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498855.407964:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885687936:0@lo:400:kworker.0 00000100:00100000:1.0:1789498855.408042:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498855.408081:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498855.408087:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885687808:0@lo:400:kworker.0 00000100:00100000:1.0:1789498855.408134:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498855.408166:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885687936 00000100:00100000:1.0:1789498855.408176:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885687936 00000100:00100000:2.0:1789498855.408415:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885687808 00000100:00100000:2.0:1789498855.408420:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885687808 00000100:00100000:3.0:1789498855.408933:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885687680:0@lo:400:kworker.0 00000100:00100000:3.0:1789498855.408975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789498855.409755:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498855.409784:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885687680 00000100:00100000:0.0:1789498855.409790:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885687680 00000100:00100000:0.0:1789498855.409826:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789498855.409835:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885687680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498855.409925:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885687680:12345-0@lo:400:kworker.0 Request processed in 90us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498855.409932:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789498855.409975:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885687680:0@lo:400:kworker.0 00000100:00100000:2.0:1789498855.410066:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789498855.410075:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885687808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498855.410136:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885687808:12345-0@lo:400:kworker.0 Request processed in 63us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.410143:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789498855.410967:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789498855.410975:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885687936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498855.411025:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885687936:12345-0@lo:400:kworker.0 Request processed in 51us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.411032:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789498855.411068:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885687808:0@lo:400:kworker.0 00000100:00100000:1.0:1789498855.411081:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885687936:0@lo:400:kworker.0 00000100:00080000:3.0:1789498855.412059:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789498855.855057:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498856.876373:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498856.940431:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885688064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498856.940552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498856.940631:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885688064 00000100:00100000:2.0:1789498856.940640:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885688064 00000100:00100000:2.0:1789498856.940719:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789498856.940730:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885688064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498856.940773:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498856.940827:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885688064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.940837:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789498856.940887:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885688064:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789498856.944610:0:21487:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498856.944621:0:21487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498856.945273:0:21487:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498856.945287:0:21487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789498857.900062:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498858.869361:0:21540:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498858.869372:0:21540:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498858.869887:0:21540:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498858.869898:0:21540:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498858.900342:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498858.900427:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864730368 00000100:00100000:3.0:1789498858.900438:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864730368 00000100:00100000:3.0:1789498858.900496:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00100000:3.0:1789498858.900508:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864730368:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498858.900582:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864730368:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 77us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.900588:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00100000:0.0:1789498858.910056:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498858.910116:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498858.910197:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498858.910236:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864730496 00000100:00100000:0.0:1789498858.910255:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864730624 00000100:00100000:0.0:1789498858.910274:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864730624 00000100:00100000:3.0:1789498858.910312:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864730496 00000100:00100000:0.0:1789498858.910350:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:0.0:1789498858.910365:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864730624:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498858.910435:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2355:x1876424864730624:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498858.910447:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1789498858.912471:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864730752 00000100:00100000:1.0:1789498858.912493:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864730752 00000100:00100000:1.0:1789498858.912547:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00100000:1.0:1789498858.912556:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864730496:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498858.912620:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2355:x1876424864730496:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 65us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.912627:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00100000:1.0:1789498858.912643:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00100000:1.0:1789498858.912661:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864730752:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498858.912703:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2355:x1876424864730752:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 54us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.912710:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00080000:0.0:1789498858.914707:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498858.914717:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789498858.924399:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498859.951425:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498860.012456:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789498860.012481:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498860.013028:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1789498860.013039:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789498860.523246:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498860.523271:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885688192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498860.523342:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498860.523422:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885688192 00000100:00100000:3.0:1789498860.523431:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885688192 00000100:00100000:3.0:1789498860.523485:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789498860.523494:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885688192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498860.523542:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498860.523639:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885688192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498860.523646:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789498860.523667:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498860.523703:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaeef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885688192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498860.531233:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885688704:0@lo:400:kworker.0 00000100:00100000:0.0:1789498860.531309:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498860.531358:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498860.531365:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885688576:0@lo:400:kworker.0 00000100:00100000:0.0:1789498860.531403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498860.531434:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885688704 00000100:00100000:0.0:1789498860.531442:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885688704 00000100:00100000:0.0:1789498860.531496:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789498860.531693:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885688320:0@lo:400:kworker.0 00000100:00100000:3.0:1789498860.531729:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498860.531751:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885688832:0@lo:400:kworker.0 00000100:00100000:3.0:1789498860.531770:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498860.531786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498860.531790:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885688448:0@lo:400:kworker.0 00000100:00100000:3.0:1789498860.531810:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498860.531832:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885688576 00000100:00100000:3.0:1789498860.531835:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885688576 00000100:00100000:3.0:1789498860.531851:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885688832 00000100:00100000:3.0:1789498860.531853:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885688832 00000100:00100000:3.0:1789498860.531879:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789498860.531885:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885688576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498860.531944:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885688576:12345-0@lo:400:kworker.0 Request processed in 59us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498860.531951:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789498860.531966:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789498860.531972:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885688832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498860.531997:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885688832:12345-0@lo:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498860.532002:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789498860.532018:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885688448 00000100:00100000:3.0:1789498860.532021:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885688448 00000100:00100000:3.0:1789498860.532045:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789498860.532051:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885688448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498860.532075:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaeef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885688448:12345-0@lo:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498860.532116:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789498860.532152:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885688448:0@lo:400:kworker.0 00000100:00100000:3.0:1789498860.532164:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885688832:0@lo:400:kworker.0 00000100:00100000:0.0:1789498860.532351:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885688704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498860.532410:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885688704:12345-0@lo:400:kworker.0 Request processed in 905us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498860.532416:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789498860.532440:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885688320 00000100:00100000:0.0:1789498860.532444:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885688320 00000100:00100000:0.0:1789498860.532477:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789498860.532484:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885688320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498860.532649:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885688320:12345-0@lo:400:kworker.0 Request processed in 165us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498860.532655:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:0.0:1789498860.532681:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498860.532686:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498860.532701:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885688320:0@lo:400:kworker.0 00000100:00100000:0.0:1789498860.532724:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885688576:0@lo:400:kworker.0 00000100:00100000:0.0:1789498860.532735:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885688704:0@lo:400:kworker.0 00010000:00010000:2.0:1789498860.972839:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498861.031059:0:21591:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789498861.031068:0:21591:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789498861.031644:0:21591:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1789498861.031653:0:21591:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789498861.995462:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498862.070931:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885688960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498862.071018:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498862.071464:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885688960 00000100:00100000:1.0:1789498862.071474:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885688960 00000100:00100000:1.0:1789498862.071551:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789498862.071561:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885688960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498862.071647:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498862.071701:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885688960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498862.071709:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1789498862.071769:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498862.071811:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885688960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498863.020966:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789498863.660289:0:21654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: request on 0x200000bd1:0x4:0x0 is not SUCCEED on mds1 00000100:00100000:0.0:1789498864.020036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498864.020085:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498864.020137:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498864.020169:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498864.020202:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864731008 00000100:00100000:0.0:1789498864.020215:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864731008 00000100:00100000:0.0:1789498864.020296:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864731264 00000100:00100000:0.0:1789498864.020300:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864731264 00000100:00100000:0.0:1789498864.020324:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 229 00000100:00100000:0.0:1789498864.020345:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864731008:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498864.020439:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864731008:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498864.020447:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 229 00000100:00100000:0.0:1789498864.020465:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00100000:0.0:1789498864.020470:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864731264:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498864.020492:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864731264:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 22us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498864.020497:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00080000:0.0:1789498864.020517:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498864.020610:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864731136 00000100:00100000:1.0:1789498864.020615:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864731136 00000100:00100000:1.0:1789498864.020654:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:1.0:1789498864.020662:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864731136:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.020694:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864731136:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.020709:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:2.0:1789498864.021062:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864730880 00000100:00100000:2.0:1789498864.021067:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864730880 00000100:00100000:2.0:1789498864.021139:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:2.0:1789498864.021147:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864730880:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498864.021182:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864730880:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498864.021188:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00080000:0.0:1789498864.021583:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789498864.043256:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498865.067655:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 36897 lines, 36897 kept, 0 dropped, 0 bad.